database design - Is it a good idea to have many keyspaces and potentially thousands of tables in Cassandra? -


so, i've been using cassandra while , architecture of database designed in way unusual me. fact don't have enough knowledge decide if that's design or not i'm new whole big data thing.

here's simplification:

  • we have vendors
  • each vendor have clients
  • for each vendor, create own keyspace in cassandra.
  • for each client of vendor, create approximately 12-15 tables in vendor's keyspace. clientid_tablename.
  • tables created dynamically when client created. slow , i'm afraid cassandra fail propagate schema when under load of other operations.
  • all table have same schema, there no special modelling given client.
  • due nature of our data, around 5 of these tables can potentially have millions, if not billions, of rows.

because of distributed nature of cassandra, never think such "manual" division of data needed or beneficial.

this single application have dozens of keyspaces , potentially thousands of tables per keyspace. won't impact performance negatively?

the impression given design allows spread data more evenly, causing less performance impact when searching within single table. didn't make sense me, didn't have arguments counter experience cassandra , so-called design big data is, @ best, limited. benefit can think of have different keyspace settings per vendor. don't think trumps of added complexity.

in short, idea?

first of all, when moving rdbms cassandra, have re-design erd, , in cases, moving standard, , normalized schema bad decision. right trying move existing schema cassandra.

you have table creation per vendor etc. workflow. need understand why working way, , if need in cassandra @ all. in general can have many tables, , many keyspaces (there limits, high) not fit cassandra modeling @ all.

in cassandra, should build tables based on queries , not entity,object,relation etc... data duplication not considered problem, trade off between performance , storage needed.

i suggest take course data modeling in cassandra datastax. it's great course, , it's totally free::

https://academy.datastax.com/courses


Comments

Post a Comment

Popular posts from this blog

commonjs - How to write a typescript definition file for a node module that exports a function? -

consider, toml node module can use: // toml.d.ts declare module toml { export function parse(value:string):any; } declare module "toml" { export = toml; } then: /// <reference path="../../../../../defs/toml/toml.d.ts"/> import toml = require('toml'); toml.parse(...); however, node module export single function, such 'glob' ( https://github.com/isaacs/node-glob ). the node usage of module be: var glob = require("glob") glob("*.js", {}, callback(err, files) { ... }); you'd naively expect this: // glob.d.ts declare function globs(paths:string, options:any, callback:{(err:any, files:string[]):void; ...but because typescripts 'import' semantics bit strange, seems can use 'import .. = require()' statement alias modules . trying call: /// <reference path="../../../../../defs/glob/glob.d.ts"/> import blog = require('glob'); results in: error ts2072: mod...
Read more

openid - Okta: Failed to get authorization code through API call -

i'm integrating okta own idp server using okta's api. i'm implementing authorization code flow following steps below: in own server, use /api/v1/authn endpoint sessiontoken. use sessiontoken obtain authorization calling endpoint: /oauth2/v1/authorize?client_id=" + clientid + "&sessiontoken=" + sessiontoken + "&response_type=code&response_mode=query&scope=openid&redirect_uri=" + redirecturl + "&state=evanyang&nonce=" it's supposed return response status code 302 , location header containing redirect url code value. however, keep getting response status code 200 , without location header, html body saying "you using unsupported browser." , "javascript disabled on browser." according api documentation: http://developer.okta.com/docs/api/resources/oidc.html#authentication-request , sessiontoken parameter sufficient this: an okta one-time sessiontoken. allows api-based ...
Read more

ios - Change Storyboard View using Seague -

i have following code checks connection server, , depending on want change views if no connection found. nsstring *connect = [nsstring stringwithcontentsofurl:[nsurl urlwithstring:@"http://myserver.com"] encoding:nsutf8stringencoding error:nil]; if (connect == null) { [self performseguewithidentifier:@"network_failure" sender:self]; } else { // other code here } my problem not change views. have added storyboard segue between 2 views identifier of network_failure . not have navigation controller or that, problem? thanks help! no not problem. first of all, in objectivec exists nil object oriented null . must use that. so: if(connect == nil) or better: if(!connect) so due fact nil not same of null , probably code does't enter in if scope . you have been able discover breakpoint. anyway: be sure set trigger segue (line) 2 view controller , , name network_failure (that not best name. should instead view1toview2 ) as, m...
Read more