7/22/2011

[MySQL][Spider][VP]Spider-2.26 VP-0.15 released

I'm pleased to announce the release of Spider storage engine version 2.26(beta) and Vertical Partitioning storage engine version 0.15(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/
Vertical Partitioning is a Storage Engine for vertical partitioning for a table.
http://launchpad.net/vpformysql

Recently, I can't upload the binary file to Launchpad, so I put the binary file at the following. Please use the following for downloading binary file.
http://spiderformysql.com/download_spider.html

The main changes in this version are following.
Spider
- Add table parameter "active_link_count", "read_only_mode", "first_read" and "second_read".
- Add server parameter "spider_read_only_mode", "spider_first_read", "spider_second_read", "spider_remote_time_zone" and "spider_sync_time_zone".
  "active_link_count" is a parameter for using Active-Standby database for data node. Normally, set "active_link_count" to 1 for using Active-Standby data node. Currently, this feature supports only Active-Standby that can switch immediately. For this changing, Spider's management table was changed from previous version, please execute "install_spider.sql" for upgrading.
- Reducing access to data nodes.
  By this change, even if a shard is crushed, you can continue accessing to other shard.

Vertical Partitioning
  This release is bug fix release.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

4 comments:

  1. Hi,
    When I compile the recent package under ubuntu 11.04 I get:
    Linking CXX shared module ha_spider.so
    /usr/bin/ld: CMakeFiles/spider.dir/spd_trx.cc.o: relocation R_X86_64_PC32 against undefined symbol `mysql_sysvar_hs_r_conn_recycle_mode' can not be used when making a shared object; recompile with -fPIC
    /usr/bin/ld: final link failed: Bad value
    collect2: ld returned 1 exit status
    make[2]: *** [storage/spider/ha_spider.so] Error 1
    make[1]: *** [storage/spider/CMakeFiles/spider.dir/all] Error 2
    make: *** [all] Error 2
    root@cudastartub:/tmp/SPIDER/mysql-5.5.14-spider-2.26-vp-0.15-hs-1.0#

    How to
    Thanks Arman.

    ReplyDelete
  2. Hi,

    You don't need to build from source code.
    You can get some binary from the following.
    http://spiderformysql.com/download_spider.html

    Thanks,
    Kentoku

    ReplyDelete
  3. Thanks, We are able to run 6 instances of spider.
    We got yet another problem on ingest:


    with mysql C API we try to fill the table using the prepared statements.

    The code is able to fill normal MyISAM table, but when we use Spider
    engine it losses connection after about 30k inserts: with message:

    mysql_stmt_execute()
    Unable to connect to foreign data source: (null)


    Interesting that bulk ingest in to table through CSV file using
    mysqlclient command line works w/o problems.

    Any ideas are appreciated.

    We have spider latest version with MySQL 5.5.14.

    The little snippet shows where the error was produced.
    /*BEGIN SNIP*/
    /* Bind the buffers */
    if (mysql_stmt_bind_param(stmt, bind))
    {
    fprintf(stderr, " mysql_stmt_bind_param() failed\n");
    fprintf(stderr, " %s\n", mysql_stmt_error(stmt));
    exit(0);
    }
    /* Execute the INSERT statement - 1*/
    if (mysql_stmt_execute(stmt))
    {
    fprintf(stderr, " mysql_stmt_execute()");
    fprintf(stderr, " %s\n", mysql_stmt_error(stmt));
    //After ~30K commits execute is failing
    exit(0);
    }
    /*END SNIP*/

    Thanks beforehand
    Arman.

    ReplyDelete
  4. Hi, Arman

    > The code is able to fill normal MyISAM table, but when we use Spider
    > engine it losses connection after about 30k inserts: with message:
    I think it probably caused lack of port.

    Please set "spider_conn_recycle_mode=1" to my.cnf and try again.

    Thanks,
    Kentoku

    ReplyDelete