Set up a simple 2 Shard MongoDB 3.0 database without replication in AWS using the new WiredTiger storage engine, verify the installation and use for some basic performance tests for a customer needing fast metadata storage for a high volume 3D imaging application.
5 EC2 instances were created inside an Amazon Web Services Virtual Private Cloud (VPC) with the necessary subnets, route tables, security groups and elastic IPs.
One Mongo config server only was used and 2 EC2 instances of T2-Medium size (4gb 2cpu) were used as Shard servers. A java test class was executed on the client instance connecting to localhost mongos using Mongo and Bson java drivers.
Inserts were unordered bulk inserts of 100,000 small records (50-80 bytes) using Oracle Java 7 with Mongo 3.0 JDBC driver, Wiredtiger storage engine with no compression.
The 1st column is the average time in millseconds per record inserted and the second column is the number of records in a batch.
0.98 ms/rec 1
0.16 ms/rec 10
0.06 ms/rec 100
0.04 ms/rec 1000
The 2 Shards' yaml configuration file is
See AWS Scenario 2: VPC with Public and Private Subnets (NAT)
Deploy a Sharded Cluster
If you need any more information as to the AWS or MongoDB configuration please contact us firstname.lastname@example.org
Database Architecture, Migration, Data models