0

Note that I am not asking how many files NTFS can store per folder (that's been covered here and here).

I would like to know what others consider an "optimal" number for enumerating files in NTFS folders. Specifically, I am storing ~20kb images. It seems in the tens of thousands of files, that Windows Explorer begins to have problems (i.e. taking long amounts of time) displaying the file lists.

Should I cap the file quantity at 10k? 5k? Is there some "optimal" number like 4096 which will give me the best performance when navigating folders?

JYelton
  • 3,277

2 Answers2

2

There's no magical optimal number, it just takes Explorer longer depending on how many files it needs to look at.

If you're browsing with Explorer, I'd try and keep it under 2000-3000 per folder, but that's a personal preference.

That said, I discourage using Explorer to do anything with a massive amount of files. Stick with the command line if at all possible. We have a guy here that insists on manually browsing through image folders here that have about 900k files apiece, and he's miserable for it.

Hyppy
  • 3,770
1

Well you asked a bigger question than you might think...the short answer is no there isn't an optimal number as you've presented the question.

It's apparent it's important enough that you would like some optimization but not important enough that you care to give many more details. I'd say don't worry about it if most other variables remain unchanged and all you want to experiment with is number of files in an NTFS folder. because the amount of optimization will be hardly noticeable to you if you are simply using explorer. If you really don't want to change anything I'd say you should focus on things like disabling windows disk indexing which is very intensive bookeeping which slows down your PC (though there might be certain reasons to use it). maybe a great alternative for you is using a program like picasa, which is really good at handling large numbers of image files and accessing them efficiently.

without other details like how often you update files, how long before migration, how often are they accessed before migration, exactly why are you accessing such a large repository of image files using NTFS explorer, etc., all sorts of other details that would help in optimizing your answer, it's hard to say what would best help you. if you really want to make a serious stride in optimizing file access set up an inexpensive RAID configuration. good luck hope i said soimething that may be useful.

.

jojobe
  • 11