Origin of big data

Here are three links that are worth your time.

  • Who came up with the name big data? The an­swer is much older than you think. Even the “three Vs” of big data (volume, ve­lo­city, vari­ety) date back to 2001.
  • JC Penney’s park­ing lots are empty­ing. The de­cline neatly cor­rel­ates with their stock price. Satellite im­agery is also be­ing used to fore­cast “… things like pover­ty (by track­ing build­ing height and rooftop ma­ter­i­al), oil in­vent­ory (by look­ing at im­ages of tanks and drilling rigs), and ag­ri­cul­tur­al yields (by ob­serving crops and ana­lyz­ing weather data)”
  • JP Morgan uses ma­chine learn­ing to auto­mat­ic­ally “read” thou­sands of con­tracts and in­ter­pret them. This gets us much closer to the Bill Gates mile­stone: “… when com­puters can read and un­der­stand in­form­a­tion like hu­mans do.”

Soon, we can leave the read­ing to the ma­chines and go out Saturday night.

Moneycontrol ties up with Gramener for Data Analysis of elections

Moneycontrol’s Election Analytics Centre: Track as­sembly polls

Moneycontrol has tied up with data ana­lyt­ics firm Gramener and polit­ic­al com­ment­at­ors to bring you a wealth of data and ana­lys­is on the elec­tions, both in the run-up to count­ing day, and on the day of the ver­dict (Saturday, March 11).

Gramener’s Data Visualisation workshop for students of NID, Bangalore

Gramener or­gan­ised a design work­shop at the National Institute of Design (NID), Bangalore a few weeks back. The one-day ses­sion was or­gan­ised for the 2nd year stu­dents of Master of Design (M. Des.) course spe­cial­ising in ‘Information Design’. The work­shop was on “Visual data rep­res­ent­a­tion & design of ef­fect­ive Business Dashboards”. This was handled by Ganes Kesari B, Head of Design & Analytics at Gramener.

The ses­sion in­tro­duced the fun­da­ment­als of data visu­al­isa­tion by present­ing a frame­work for visu­al con­sump­tion of data. The ef­fect­ive mod­es of in­form­a­tion design were re­viewed by un­der­stand­ing prin­ciples of hu­man cog­ni­tion and how hu­mans pro­cess in­form­a­tion. The mod­ule on data ana­lys­is fa­mil­i­ar­ised the par­ti­cipants with ba­sic tech­niques of ex­plor­at­ory data ana­lys­is and ex­trac­tion of un­usu­al, in­ter­est­ing in­sights.

Visualisation was stud­ied by break­ing it down in­to the con­stitu­ent ele­ments and look­ing at the ba­sic list of visu­al en­cod­ings like po­s­i­tion, col­or, shape, angle etc. Other im­port­ant con­cepts covered in­cluded the gram­mar of graph­ics, fun­da­ment­als of in­form­a­tion present­a­tion, and prin­ciples of build­ing visu­al­iz­a­tion dash­boards. The con­cepts were covered by dis­tilling the learn­ings from stal­warts in the field like Edward Tufte, Stephen Few and Ben Schneiderman among­st oth­ers.

Finally, the learn­ings were put to prac­tice through a live in­dustry case-study where­in the stu­dents at­temp­ted to fol­low the en­tire data visu­al­isa­tion li­fe­cycle with the provided data ex­er­cise. The stu­dents show ex­cep­tion­al in­terest and did a great job of as­sim­il­at­ing the learn­ings and rap­idly ap­ply­ing them by fol­low­ing the sug­ges­ted visu­al­isa­tion pro­cess flow: re­quire­ments re­view – use case pri­or­it­isa­tion – data ana­lys­is – design con­cep­tu­al­isa­tion – fi­nally the com­plete solu­tion present­a­tion.

The thirst for know­ledge and quest to un­der­stand in­dustry prac­tices was evid­ent with the vol­ley of ques­tions through the day, which were around areas in­clud­ing:

  • Roles avail­able for Information design in the field of Data sci­ence and the mix of skills needed, from among­st a com­bin­a­tion of do­main, math, stats, cre­ativ­ity and visu­al design
  • Visualisation en­gage­ment li­fe­cycle fol­lowed in the in­dustry and the prac­tic­al chal­lenges en­countered in re­quire­ments & design ideation
  • Importance of data & ex­plor­at­ory ana­lys­is pri­or to em­bark­ing on the in­form­a­tion design jour­ney
  • Addressing age-old is­sues of bridging gaps between design & de­vel­op­ment trans­la­tion, while present­ing in­form­a­tion
  • How one can ad­opt a user-centred design pro­cess to en­sure that the solu­tion meets user ex­pect­a­tions
  • Toolsets used to cre­ate stun­ning visu­al­isa­tions, and how ad­op­tion level in the in­dustry to un­con­ven­tion­al and new­er, cre­at­ive gen­res of in­form­a­tion present­a­tion

This ses­sion was a part of the on­go­ing in­dustry out­reach ini­ti­at­ives, un­der the part­ner­ship between Gramener and NID, Bangalore. As part of the part­ner­ship there are in­ter­ac­tions and work­shops sched­uled for the stu­dents around the areas of Data Visualisation, Information Design and Cartographic visu­al rep­res­ent­a­tions.