Throttling mysql command line

[Eric Cope]

I only have one column that is needed for the fulltext search. I think
it would be easier to integrate solr than to try and get MySQL to be
better. But this comes from someone who has never used solr.

So far, I have used csplit to split the file, insert one record, sleep
for 0.01s and repeat. Its slower, but at least it doesn't cripple the
server and when we launch this app, we can invest in solr then.

On that note, I'd be interested in any tutorials anyone might have
with respect to getting solr up and running. my attempts thus far have
failed, all on CentOS.

Eric


On Wed, Jan 18, 2012 at 3:48 PM, Lisa Kachold <lisakachold at obnosis.com> wrote:
> Hi!
>
>
> On Wed, Jan 18, 2012 at 1:27 PM, Alex Dean <alex at crackpot.org> wrote:
>>
>> On Jan 18, 2012, at 1:30 PM, Eric Cope wrote:
>>
>> > good point. Its just a series of INSERTs (8000 or so), but the table
>> > has a fulltext index, so its pretty slow (10 records/sec).
>> > It sounds like I should split up the batch script, then load a few,
>> > pause, load a few, pause, etc.
>> > Any ideas?
>> >
>> > Eric
>>
>> Look at 'alter table disable/enable keys'
>>  you tell the server not to update any indexes while you're doing your
>> bulk load.
>>  http://dev.mysql.com/doc/refman/5.1/en/alter-table.html
>>
>> Consider loading via tab-delimited rather than SQL.
>>  Much much faster, but the data file must be on the mysql server's
>> filesystem.
>>  http://dev.mysql.com/doc/refman/5.1/en/load-data.html
>>
>> As others suggested, do inserts in batches and sleep.
>>
>> alex
>
> --
>
> How about clustering ndbcluster; with a query only node?
>
> (602) 791-8002  Android
> (623) 239-3392 Skype
> (623) 688-3392 Google Voice
> **
> HomeSmartInternational.com
>
>
> ---------------------------------------------------
> PLUG-discuss mailing list - PLUG-discuss at lists.plug.phoenix.az.us
> To subscribe, unsubscribe, or to change your mail settings:
> http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss