I'm pleased to announce the release of Spider storage engine version 2.26(beta) and Vertical Partitioning storage engine version 0.15(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql
Recently, I can't upload the binary file to Launchpad, so I put the binary file at the following. Please use the following for downloading binary file.
http://spiderformysql.com/download_spider.html
The main changes in this version are following.
Spider
- Add table parameter "active_link_count", "read_only_mode", "first_read" and "second_read".
- Add server parameter "spider_read_only_mode", "spider_first_read", "spider_second_read", "spider_remote_time_zone" and "spider_sync_time_zone".
"active_link_count" is a parameter for using Active-Standby database for data node. Normally, set "active_link_count" to 1 for using Active-Standby data node. Currently, this feature supports only Active-Standby that can switch immediately. For this changing, Spider's management table was changed from previous version, please execute "install_spider.sql" for upgrading.
- Reducing access to data nodes.
By this change, even if a shard is crushed, you can continue accessing to other shard.
Vertical Partitioning
This release is bug fix release.
Please see "99_change_logs.txt" in the download documents for checking other changes.
Enjoy!
Subscribe to:
Post Comments (Atom)
Hi,
ReplyDeleteWhen I compile the recent package under ubuntu 11.04 I get:
Linking CXX shared module ha_spider.so
/usr/bin/ld: CMakeFiles/spider.dir/spd_trx.cc.o: relocation R_X86_64_PC32 against undefined symbol `mysql_sysvar_hs_r_conn_recycle_mode' can not be used when making a shared object; recompile with -fPIC
/usr/bin/ld: final link failed: Bad value
collect2: ld returned 1 exit status
make[2]: *** [storage/spider/ha_spider.so] Error 1
make[1]: *** [storage/spider/CMakeFiles/spider.dir/all] Error 2
make: *** [all] Error 2
root@cudastartub:/tmp/SPIDER/mysql-5.5.14-spider-2.26-vp-0.15-hs-1.0#
How to
Thanks Arman.
Hi,
ReplyDeleteYou don't need to build from source code.
You can get some binary from the following.
http://spiderformysql.com/download_spider.html
Thanks,
Kentoku
Thanks, We are able to run 6 instances of spider.
ReplyDeleteWe got yet another problem on ingest:
with mysql C API we try to fill the table using the prepared statements.
The code is able to fill normal MyISAM table, but when we use Spider
engine it losses connection after about 30k inserts: with message:
mysql_stmt_execute()
Unable to connect to foreign data source: (null)
Interesting that bulk ingest in to table through CSV file using
mysqlclient command line works w/o problems.
Any ideas are appreciated.
We have spider latest version with MySQL 5.5.14.
The little snippet shows where the error was produced.
/*BEGIN SNIP*/
/* Bind the buffers */
if (mysql_stmt_bind_param(stmt, bind))
{
fprintf(stderr, " mysql_stmt_bind_param() failed\n");
fprintf(stderr, " %s\n", mysql_stmt_error(stmt));
exit(0);
}
/* Execute the INSERT statement - 1*/
if (mysql_stmt_execute(stmt))
{
fprintf(stderr, " mysql_stmt_execute()");
fprintf(stderr, " %s\n", mysql_stmt_error(stmt));
//After ~30K commits execute is failing
exit(0);
}
/*END SNIP*/
Thanks beforehand
Arman.
Hi, Arman
ReplyDelete> The code is able to fill normal MyISAM table, but when we use Spider
> engine it losses connection after about 30k inserts: with message:
I think it probably caused lack of port.
Please set "spider_conn_recycle_mode=1" to my.cnf and try again.
Thanks,
Kentoku