0
Answered

Serious trouble with folders

jh.hamminga 10 months ago updated by Vlad R 10 months ago 3

Currently i'm testing a install on my nas. The instructions worked flawlessly. With a few items all runs well and operates very nice. But we have to move up from a few to many and so I did and it brings things to a screeching halt. The many in this story are around 10.000 pictures in a single folder, around 1.8 gig.

Uploaded with zip and although this worked there is a limitation of 2 gig!. uploading and unzipping costs hours after that accessing is almost unpossible. It looks like thumbs are created on the spot, so that scrolling becomes a daunted task. The nas will become unresponsive and it looks like scripts time out.

I couldn't find a way to point filerun directly to a folder to access it's contents.

It sounds like a lot but it is nothing in a enterprise enviroment with terra bytes of info. 

Is there something i'm missing or something miss configured or what....

please advise

John

Answered

There is no limitation from FileRun when it comes to size of uploaded files.

You point FileRun to existing folders by editing user accounts and setting their home folders to match the paths.

You are welcome to organize your files in subfolders. Having 10.000 files in one folder's listing means you are having a problem with organizing your data. No Enterprise client of ours, regardless how big the company, has that many files dumped on the same level, for obvious reasons.

Hi Vlad,

max 2 gig zip, or it's php I don't know, unzipping takes time there is a limit. Synology runs in trouble. A quick test on a local machine does the same!

Well about that 10000 files, i'm sorry to say that is nothing. I use jpg, just for testing. Our data, runs and pulls sensor data and fills and could create a multiple that in one directory easy. (even dropbox, mega, or google docs can handle that).

That's one situation, the reverse is also needed. A small number of very big files, but searchable.

Are you saying that filerun isn't capable of handling big data? The next fase would be indexing, searching sharing, deleting and things like that. Could filerun handle this?

I will try to point to a existing folder with a user and see how that goes. (the folders will be big)

FileRun is simply not designed to be used with massively unorganized data / file dumps in single folders. 

FileRun is designed to be used with human-friendly data. It is very unusual for somebody to be browsing a folder that lists thousands of files. Particularly images which can easily be organized to the benefit of the users.

You could have your sensor data be put into subfolders based on some logic (or better yet, a database), or you might want to look for a different solution that fits your particular usage better.