Mongodb sharding performance issue -


test :
- insert 200 images (300-800ko/img) using directly replica set
- insert 200 images (300-800ko/img) using same replica set shard.

i realize these operations have different execution time ...
- replica set : 200 pictures in around 30 sec.
- sharding : around 3sec./picture => around 7- 8 minutes these 200 pictures !!!

==> don't understand why these inserts slow sharding ... <==

conditions :
- php driver
- gridfs : fs.chunks sharded
- write concern : majority
- 1 thread : php, parse array contains path pictures, , store picture in mongodb using gridfs.

ressources :
(all servers openvz vm's on proxmox plate-form (all on same machine (for test)))
3 mongod : 6go ram (50% while inserting), 1cpu (99% idle while inserting...)
2 arbiters : 512mo ram (100mo used), 1cpu(100% idle ...)
1 config : 2go ram (200mo used), 1 cpu(100% idle ...)
1 mongos : 512mo ram (100mo used), 1cpu (98%idle while inserting...)

notes :
while inserting with sharding :
- ~1->5% cpu utilization mongod, mongos , config_svr instances
- ~5% ram utilization mongos/config_svr
- ~50% mongod
- network throughput (metrics taken on mongod): mongos <--> primary mongod : ~300kb/s

while inserting without sharding (replica set directly) :
- network throughput (metrics taken on mongod): hosting pictures server <--> primary mongod : ~30mb/s

php class : pastebin.com_[mongodb-class] (that contains code interact mongodb)
added @ top of class :
mongolog::setlevel(mongolog::all)
mongolog::setmodule(mongolog::all)
display_errors=1
error_reporting=-1
the client directly calls storefile() method of class...
result page here : pastebin.com_[resultpage]

documents inserted simple as: mongoid, picture_binaries_data
i've no meta-data, mongodb generates during storing process.

here's result of sh.status() on mongos : 

      mongos> sh.status()     --- sharding status ---       sharding version: {             "_id" : 1,             "version" : 3,             "mincompatibleversion" : 3,             "currentversion" : 4,             "clusterid" : objectid("518372e807be4a15fb391fab")     }       shards:             {  "_id" : "rs0",  "host" : "rs0/192.168.36.101:27017,192.168.36.102:27017,192.168.36.103:27017" }       databases:             {  "_id" : "admin",  "partitioned" : false,  "primary" : "config" }             {  "_id" : "test",  "partitioned" : false,  "primary" : "rs0" }             {  "_id" : "bepics_gallery",  "partitioned" : false,  "primary" : "rs0" }             {  "_id" : "bepics_images",  "partitioned" : true,  "primary" : "rs0" }                     bepics_images.fs.chunks                             shard key: { "files_id" : 1 }                             chunks:                                     rs0     9                             { "files_id" : { "$minkey" : 1 } } -->> { "files_id" : objectid("5183926028d40965190000ea") } on : rs0 { "t" : 1, "i" : 1 }                             { "files_id" : objectid("5183926028d40965190000ea") } -->> { "files_id" : objectid("5183a1be28d409051e000004") } on : rs0 { "t" : 1, "i" : 3 }                             { "files_id" : objectid("5183a1be28d409051e000004") } -->> { "files_id" : objectid("5183a2a728d409051e00008f") } on : rs0 { "t" : 1, "i" : 5 }                             { "files_id" : objectid("5183a2a728d409051e00008f") } -->> { "files_id" : objectid("5183b70328d409cc1e00008f") } on : rs0 { "t" : 1, "i" : 7 }                             { "files_id" : objectid("5183b70328d409cc1e00008f") } -->> { "files_id" : objectid("5183c6f728d409e526000037") } on : rs0 { "t" : 1, "i" : 9 }                             { "files_id" : objectid("5183c6f728d409e526000037") } -->> { "files_id" : objectid("5183c76028d409e526000076") } on : rs0 { "t" : 1, "i" : 11 }                             { "files_id" : objectid("5183c76028d409e526000076") } -->> { "files_id" : objectid("5183c7cb28d409ea2600001f") } on : rs0 { "t" : 1, "i" : 13 }                             { "files_id" : objectid("5183c7cb28d409ea2600001f") } -->> { "files_id" : objectid("5183c84e28d409ea2600006d") } on : rs0 { "t" : 1, "i" : 15 }                             { "files_id" : objectid("5183c84e28d409ea2600006d") } -->> { "files_id" : { "$maxkey" : 1 } } on : rs0 { "t" : 1, "i" : 16 }

to connect cluster, use mysql table store servers configuration ip, port, priority, rs_name, ...
in repica set archi. => build connection-pool name of replica set, , 3 first servers, sorted priority.
in sharding archi. => build connection-pool all mongos.
(all adresses in connections-pool formatted ip:port)

can me solve or explain me ?


Comments

Post a Comment

Popular posts from this blog

php - Why I am getting the Error "Commands out of sync; you can't run this command now" -

the documentation of error mentioned in title says if commands out of sync; can't run command now in client code, calling client functions in wrong order. this can happen, example, if using mysql_use_result() , try execute new query before have called mysql_free_result(). can happen if try execute 2 queries return data without calling mysql_use_result() or mysql_store_result() in between. from here: http://dev.mysql.com/doc/refman/5.0/en/commands-out-of-sync.html but in first query not fetching data mysql database, inserting. , in second query getting data database. here code $connection = mysqli_connect("localhost","username","password","tbl_msgs"); if(mysqli_connect_errno($connection)) { die("failed connect mysql: " . mysqli_connect_error()); } $query = "insert users (total_comments, total_views) values ({$total_comments}, {$total_views});"; $query .= "insert msgs (no...
Read more

linux - Does gcc have any options to add version info in ELF binary file? -

i mean whether gcc can insert source code version infor elf binary section or similar. not want change source file, add info gcc option in makefile. you can emit version info text file, turn text file object file statically link executable. the first step simple have write code: script or write version info in format plain text file. write makefile rule produce version.o version.txt, using objcopy . you'll have object file 2 useful symbols defined in it: beginning , end of textual version info. add generated object executable, , you'll able access version 2 ways: running strings on binary, or writing code in application print version string (you'll need declare start , end symbols variables in header file).
Read more

java - Are there any classes that implement javax.persistence.Parameter<T>? -

i'm using named queries fetch entities database using jpa , hibernate , came across puzzling me: how come there no default implementations of javax.persistence.parameter interface? i rather impressed how @staticmetamodel used criteriabuilder in jpa2 meaning type safety , don't have mess around setting string names. wanted apply similar of jpa1 ejb's i'm working on: dealergroup_.class: public dealergroup_ { public parameter<integer> id = new parameterimpl<integer>("id"); /// etc... } dealergroupfacade.class: // ... public dealergroup fetch(integer id) { typedquery<dealergroup> query = em.createnamedquery("dealergroup.fetchbyid", dealergroup.class); query.setparameter(dealergroup_.id, query); return query.getsingleresult(); } // ... i surprised find there no implementations of parameter interface - of course, implement myself absence makes me suspicious may mistake using in way? should implementing parameter...
Read more