mongodb - Is this scenario a big data project? -

-

i'm involved in project 2 phases , i'm wondering if big data project (i'm newbie in field)

in first phase have scenario:

  • i have collect huge amont of data
  • i need store them
  • i need build web application shows data users

in second phase need analyze stored data , builds report , analysis on them

some example data quantity; in 1 day may need collect , store around 86.400.000 record

now thinking kind of architecture:

  • to colect data asynchronous tecnology active mq , mqtt protocol
  • to store data thinking nosql db (mongo, hbase or other)

now solve first phase problems

but second phase?

i thinking big data sw (like hadoop or spark) , machine learning sw; can retrieve data db, analyze them , build or store in better way in order build reports , specific analysis

i wondering if best approach

how solve kind of scenario? in right way?

thank you

angelo

as answered siddhartha, whether project can tagged bigdata project or not, depends on context , buiseness domain/case of project.

coming tech stack, each of technology mentioned has specific purpose. example if have structured data, can use new age base database query support. nosql databases come in different flavours (columner, document based, key-value, etc), technology choice depends again on kind of data , use-case have. suggest pocs , analysis of technologies before taking final calls.


Comments

Post a Comment

Popular posts from this blog

javascript - Slick Slider width recalculation -

-
i'm trying add slide in panel on slick container css. carousel works except new width not being calculated when space has been added. recalibrate once advance next slide i'd happen each time panel opened or closed. i've tried adding both margin , padding, neither makes difference. ideas? https://jsfiddle.net/mhigley/dpf7mlpl/ html: <button type="button" id="button"><i class="fa fa-arrow-right"></i></button> <aside> <h2>slide in panel</h2> <ol> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> <li>list item</li> </ol> </aside> <main role="main"> <div class="sections"> <section> <article> <h2>first slide</h2> <p>lorem ipsum d...
Read more

jsf - PrimeFaces Datatable - What is f:facet actually doing? -

-
looking through primefaces code in app noticed following line: <f:facet name="header">#{trainsearch.traincount} trains</f:facet> it looks overriding header, makes sense, can explain me in little more detail? what happening line of code? complete code listed below: <p:datatable id = "results" value = "#{trainsearch.trains}" var = "train" rendered="#{not empty trainsearch.trains}" styleclass = "train-search-table horizontal-border"> <f:facet name="header">#{trainsearch.traincount} trains</f:facet> <p:column headertext = "train id"> <p:panelgrid columns="1" styleclass = "train-id-grid" layout = "grid"> <h:outputtext styleclass = "train-id-label" value="#{train.traini}"/> <h:outputtex...
Read more

angular2 services - Angular 2 RC 4 Http post not firing -

-
i trying fire post request app , it's not working, tried multiple ways. don't see request being fired under network tab in chrome. not sure problem is, appreciated. import { injectable } '@angular/core'; import { http, headers } '@angular/http'; @injectable() export class userservice{ private _url="users"; constructor(private _http: http){ } checkifusernameexists(username){ return this._http.get(this._url+"/"+username) .map(response => response.json()) } createuser(user){ let headers = new headers(); headers.append('content-type', 'application/json') console.log(json.stringify(user)); return this._http.post(this._url, json.stringify(user),{headers: headers}) .map(response => response.json()) } } first need capture error , solve error: this._http.post(this._url, json.stringify(user),{headers: headers}) .subscribe( ...
Read more