Number of files in a directory / performance
keith smith
klsmith2020 at yahoo.com
Mon Nov 20 08:47:09 MST 2006
Thanks for your reply.
Given several thousand files is my current threshold, I should be safe for a long while.
If and when I reach that mark I am assuming the threshold will higher.
Thanks again,
Keith
Darrin Chandler <dwchandler at stilyagin.com> wrote: On Sun, Nov 19, 2006 at 08:00:11PM -0800, keith smith wrote:
>
> About 18 years ago I was working on the file/server (not client/server) based desktop database that ran in DOS.
>
> The maker of the product suggested that we put no more than 300 files in each directory because DOS would slow and we would experience a degradation in performance.
>
> I was thinking of this and wondering if such a limit would exist in Linux in a web server environment. In other words if say I have 500 pages in one directory is that or some other quantity of pages going to cause the web server to slow?
*nix has less of a problem with this than DOS did. For any filesystem
and operating system there are parameters than can affect performance.
You usually won't need to tweak these at all, even with a couple of
thousand files. This falls under the Rules of Optimization (paraphrased
from memory, sorry):
1. Don't do it.
2. Don't do it yet.
3. Profile. (optimize the right thing)
3. Measure before and after. (did you help or hurt?)
If you want to see examples of a NEED to tweak, and how to do it, Google
for what people have done for running NNTP servers (absolutely HUGE
numbers of small files, which are added and removed continuously). *IF*
you need to tweak, you must take into account your particular situation.
--
Darrin Chandler | Phoenix BSD Users Group
dwchandler at stilyagin.com | http://bsd.phoenix.az.us/
http://www.stilyagin.com/ |
---------------------------------------------------
PLUG-discuss mailing list - PLUG-discuss at lists.plug.phoenix.az.us
To subscribe, unsubscribe, or to change you mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss
- - - - - - -
Keith Smith
- - - - - - -
http://travelingcheese.com/search_engine/increase-search-engine-traffic.html
- - - - - - -
---------------------------------
Sponsored Link
Don't quit your job - take classes online and earn your degree in 1 year. Start Today
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.PLUG.phoenix.az.us/pipermail/plug-discuss/attachments/20061120/39c815e0/attachment-0001.htm
More information about the PLUG-discuss
mailing list