database vs filesystem performance

Marc Lijour marc-bbkyySd1vPWsTnJN9+BGXg at public.gmane.org
Tue Aug 9 00:28:44 UTC 2005


On August 8, 2005 01:31, Marcus Brubaker wrote:
> Marc Lijour wrote:
> >On August 8, 2005 00:32, Ansar Mohammed wrote:
> >>It all comes down to the nature of your application and data.
> >>Is your application read only? Are you modifying data? How large are the
> >>files and what kind of files are they?
> >
> >I am just getting a very fast stream of binary data which I have to store
> >(fast) with the idea of retrieving later to process it. Hence it must be
> >indexed in some way, but a coarse-grained indexing should work (many files
> >may be).
>
> If this is just an intermediary stage and all you need is coarse
> indexing (not searching) then just using the filesystem is probably the
> way to go but keep in mind that FS performance will generally suffer if
> you have too many files in a given directory.  (There are ways around
> this though.)  However, as others have said, to have a conclusive answer
> would require performance testing specific to your problem.
>
> BTW, is this on a Linux box?  You've specified MS-SQL but left the other
> option vague.  Just curious.

Imagine the worse ;-)
--
The Toronto Linux Users Group.      Meetings: http://tlug.ss.org
TLUG requests: Linux topics, No HTML, wrap text below 80 columns
How to UNSUBSCRIBE: http://tlug.ss.org/subscribe.shtml





More information about the Legacy mailing list