Full text is in innodb if you use a bleeding edge build. But I would
still recomend off loading. Untill the you can use better inserts
(load data in file) or split them up. MySQL does support sleep SELECT
SLEEP(2); for example. Run 100 then sleep 2 then run 100 and repeat
untill done. Slow for 30 min is better then locked for 8. But in any
case I recomend a slave for backups and HA.
On 1/18/12, Eric Cope <
eric.cope@gmail.com> wrote:
> I only have one column that is needed for the fulltext search. I think
> it would be easier to integrate solr than to try and get MySQL to be
> better. But this comes from someone who has never used solr.
>
> So far, I have used csplit to split the file, insert one record, sleep
> for 0.01s and repeat. Its slower, but at least it doesn't cripple the
> server and when we launch this app, we can invest in solr then.
>
> On that note, I'd be interested in any tutorials anyone might have
> with respect to getting solr up and running. my attempts thus far have
> failed, all on CentOS.
>
> Eric
>
>
> On Wed, Jan 18, 2012 at 3:48 PM, Lisa Kachold <lisakachold@obnosis.com>
> wrote:
>> Hi!
>>
>>
>> On Wed, Jan 18, 2012 at 1:27 PM, Alex Dean <alex@crackpot.org> wrote:
>>>
>>> On Jan 18, 2012, at 1:30 PM, Eric Cope wrote:
>>>
>>> > good point. Its just a series of INSERTs (8000 or so), but the table
>>> > has a fulltext index, so its pretty slow (10 records/sec).
>>> > It sounds like I should split up the batch script, then load a few,
>>> > pause, load a few, pause, etc.
>>> > Any ideas?
>>> >
>>> > Eric
>>>
>>> Look at 'alter table disable/enable keys'
>>> you tell the server not to update any indexes while you're doing your
>>> bulk load.
>>> http://dev.mysql.com/doc/refman/5.1/en/alter-table.html
>>>
>>> Consider loading via tab-delimited rather than SQL.
>>> Much much faster, but the data file must be on the mysql server's
>>> filesystem.
>>> http://dev.mysql.com/doc/refman/5.1/en/load-data.html
>>>
>>> As others suggested, do inserts in batches and sleep.
>>>
>>> alex
>>
>> --
>>
>> How about clustering ndbcluster; with a query only node?
>>
>> (602) 791-8002 Android
>> (623) 239-3392 Skype
>> (623) 688-3392 Google Voice
>> **
>> HomeSmartInternational.com
>>
>>
>> ---------------------------------------------------
>> PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us
>> To subscribe, unsubscribe, or to change your mail settings:
>> http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss
> ---------------------------------------------------
> PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us
> To subscribe, unsubscribe, or to change your mail settings:
> http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss
--
Sent from my mobile device
---------------------------------------------------
PLUG-discuss mailing list -
PLUG-discuss@lists.plug.phoenix.az.us
To subscribe, unsubscribe, or to change your mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss
(text/plain)