Welcome to the Videophile II Forum

The home of Videophile II
It is currently Mon Dec 07, 2009 10:04 am

All times are UTC [ DST ]



Welcome
Welcome to the Videophile II forum

You are invited to register here


Post new topic Reply to topic  [ 11 posts ]  Go to page 1, 2  Next
Author Message
 Post subject: Scan Location Problem
PostPosted: Thu Sep 17, 2009 8:02 pm 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
ped1gree wrote:
Now, this is strange. I just pointed it at about 2tb of all sorts of media and so far, its imported nothing.

Ive got a 5tb server here, running linux and Z: drive mapped to a smb share and Im seeing some very strange access requests.

With Z: being mapped, a VP installed on the D: drive, instead of VP scanning z:\completed\foldername\filename.wmv, its scanning for d:\program files (x86)\Videophile II\(Offline) 15CB0776\mnt\vol1\downloads\Completed\foldername\filename.wmv - "NAME INVALID"

it then updates the database and journal and by the look of it, it looks like sqlite?

At no point does it touch the Z: drive by name or by UNC. Whats even more worrying is that samba seems to disclose absolute pathing to a mount point. (here /mnt/vol1/downloads)

Once its completed, there are no playable items (of the 2112 scanned) Double clicking on an unplayable item renders a error dialogue of "Offline Volume: [Offline] 15C80776:\mnt\vol1\downloads\Completed\Torrents\foldername\filename.avi" with "filename.avi - on a disk that is not connected" etc etc

On filescan a cat /proc/smb_pid/fd shows that the process is scanning. As does the scan process itself as it shows the filename in the filename/alias field (can you put back the field that showed the folder name to that field as well please?).

On a heavy "init file scan" - the application becomes unresponsive, especially from a network. This doesnt really happen when scanning from a local harddrive. Running a procmon process on a local harddrive shows correct file access, rather than from a network handle.

I hope some of this helps

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Thu Sep 17, 2009 8:03 pm 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
TestOmaX

I've pasted this from a PM I received from ped1gree, who is using a pre-release 1.4.0 version...

Any ideas?

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Thu Sep 17, 2009 8:31 pm 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
VP2 always attempts to resolve all paths to an absolute physical path starting with the disk's serial number. This is to avoid files being added to a Library twice in teh case of ther being several mappings to the same physical location.

In the above case, 'z:\' was correctly interpreted as '15CB0776\mnt\vol1\downloads\'. What concerns me is where the 'd:\program files (x86)\Videophile II\' that is appended to the front of the path came from!

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Thu Sep 17, 2009 9:57 pm 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
OK, I've identified the cause of the problem...

This occurred because a network path share was mapped a logical drive letter. (e.g. share\folder\ mapped to Z:)

I have updated the code (small change) but it needs some rigourous testing...

TestOmaX,

Surprised this hasn't come up before? Would have thought that you have such a set-up?

EDIT: Have checked some of the libraries you have sent me in the past and those tend to have drive letters mapped to the root of a network device which may explain why you have not encountered it yet...

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Thu Sep 17, 2009 11:40 pm 
Offline
Stress Tester and General Guru
User avatar

Joined: Wed Apr 22, 2009 12:58 am
Posts: 1343
cant say much about it.

i did testing in similar setups as i have many servers here.
but there will allways be situations not covered by my setups.

i need to say in defence to myself that samba is a very complex netbui/smb/cifs server for the windows networking environment and there are many versions installed around, samba itself can be configured in many complex ways that is way out of scope to discus here.

as for the slow network scanning, this is normal on huge file sets and slow networks and / or many other combinations of cheap NICs, cheap CPUs, cheap switches, etc ....
you should notice the same slowness in windows explorer too if you start moving a large set of files.
the problem is your network

_________________
You want a stress test? Give it to me :-)


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Thu Sep 17, 2009 11:45 pm 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
This problem has now been fixed - I have had confrimation via email from ped1gree.

Subject to additional testing by TestOmaX, of course...

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Fri Sep 18, 2009 12:14 am 
Offline
Stress Tester and General Guru
User avatar

Joined: Wed Apr 22, 2009 12:58 am
Posts: 1343
of course ;)
hehe nice found guys!

_________________
You want a stress test? Give it to me :-)


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Fri Sep 18, 2009 12:17 am 
Offline
Site Admin, Founder & Videophile II Author
User avatar

Joined: Sun Nov 09, 2008 6:39 pm
Posts: 1407
Location: London, England
TestoMaX,

all my Libraries work fine under the new code and so do ped1gree's

If all yours are OK can you mark this thread as closed please?

_________________
"If you don't know where you're going, any road will take you there" - Mike Skinner


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Fri Sep 18, 2009 12:19 am 
Offline
Stress Tester and General Guru
User avatar

Joined: Wed Apr 22, 2009 12:58 am
Posts: 1343
ok will do mate

_________________
You want a stress test? Give it to me :-)


Report this post
Top
 Profile  
 
 Post subject: Re: Scan Location Problem
PostPosted: Fri Sep 18, 2009 11:12 am 
Offline
New User

Joined: Wed Sep 16, 2009 4:49 pm
Posts: 3
TestOmaX wrote:
as for the slow network scanning, this is normal on huge file sets and slow networks and / or many other combinations of cheap NICs, cheap CPUs, cheap switches, etc ....
you should notice the same slowness in windows explorer too if you start moving a large set of files.
the problem is your network


Oh no its not, not my my case :) You would drool over the network and systems I was testing around on :) Im a servers systems engineer for a rather large broadcaster and always get to play on some rather cool gear


Report this post
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 11 posts ]  Go to page 1, 2  Next

All times are UTC [ DST ]


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron