On Jan 18, 2012, at 1:30 PM, Eric Cope wrote:
> good point. Its just a series of INSERTs (8000 or so), but the table
> has a fulltext index, so its pretty slow (10 records/sec).
> It sounds like I should split up the batch script, then load a few,
> pause, load a few, pause, etc.
> Any ideas?
>
> Eric
Look at 'alter table disable/enable keys'
you tell the server not to update any indexes while you're doing your bulk load.
http://dev.mysql.com/doc/refman/5.1/en/alter-table.html
Consider loading via tab-delimited rather than SQL.
Much much faster, but the data file must be on the mysql server's filesystem.
http://dev.mysql.com/doc/refman/5.1/en/load-data.html
As others suggested, do inserts in batches and sleep.