Showing posts with label big data. Show all posts
Showing posts with label big data. Show all posts

Wednesday, November 20, 2019

Review: Cloud Info Model vs Open Data Initiative

Like every big wave of advancing technology, I'm still trying to wrap my head around the two different options of data centralization and accessibility (i.e. how I see this 'data' game construct being played in the market). Linux initiated the Cloud Information Model (CIM) and has partners signed onto their team. Microsoft initiated the Open Data Initiative (ODI) and has partners signed onto their team. I guess one of the differences is that CIM focuses on storing data in the cloud whereas ODI allows more flexibility as to where to store the data yet enforcing a common metadata structure.

Quick look at ODI


Quick look at CIM


I need to do more research. I'm curious to know where the data developers stand on this like those who worked on MongoDB, Oracle, MS-SQL, and the MySQL community.

References
https://www.zdnet.com/article/whats-next-for-the-open-data-initiative/
https://www.linuxfoundation.org/press-release/2019/11/amazon-web-services-genesys-salesforce-form-new-open-data-model/
https://www.microsoft.com/en-us/open-data-initiative
https://www.cloudinformationmodel.org/

Wednesday, May 1, 2019

Review: Microsoft & Cray accelerate supercomputing in the cloud

This is fantastic news! The capability to super-compute in the cloud is another big milestone towards the vision laid out by Microsoft. Who better to partner on such a mission than Cray?

Read Article
https://azure.microsoft.com/en-us/blog/supercomputing-in-the-cloud-announcing-three-new-cray-in-azure-offers/?cdn=disable

Don't know why or can't connect the dots? Then check out this article.
https://www.netapp.com/us/info/what-is-high-performance-computing.aspx

Or, watch the video by Cray:



References


  1. https://www.cray.com/solutions/supercomputing-as-a-service/cray-in-azure
  2. https://qz.com/1113112/satya-nadella-just-hit-one-of-microsofts-most-ambitious-goals-a-year-early/



Monday, April 22, 2019

Review: Pyodide (Python in the Browser)

Although I'm not experienced in Python (at this point), I continue to keep watch on the advances the Python community is making. Like staff data engineer Mike Droettboom says, "a standard Python interpreter that runs entirely in the browser" will dramatically improve the game of data computation on the web.

Read Article

https://venturebeat.com/2019/04/16/mozilla-details-pyodide-a-project-that-aims-to-bring-python-to-web-browsers/

In-Depth Article by Mozilla

https://hacks.mozilla.org/2019/04/pyodide-bringing-the-scientific-python-stack-to-the-browser/

Other like-tools

Existing projects trying to address the current data engineering problems with the browser:

  1. Transcrypt
  2. Brython
  3. Skulpt
  4. PyPyJs

Monday, November 5, 2018

Jupyter Notebooks - what is it?

I stumbled upon this article and became very curious as to what a Jupyter notebook is.


Main website



Online Tutorials

Seems pretty cool for people interested in Data Science and crunching data especially using Python (or iPython). So, I decided to watch some YouTube videos to learn a little more.



Friday, December 4, 2015

Data Analytics: Processing Images

Dev Fam,

This is pretty useful to know. Eventually, when I get the time, I'll look further into using this myself. But for now, just wanted to spread the news in case you haven't heard.

http://www.pcworld.com/article/3011757/developers-get-new-tools-from-google-to-analyze-images.html#tk.nl_today

http://thenextweb.com/google/2015/12/02/googles-new-cloud-vision-api-helps-teach-machines-to-better-understand-images/



Collecting data has always been a huge deal. Marketing terms like "big data" and "hadoop" have been constantly thrown around industries in attracting companies and customers. However, what's been difficult to analyze has been images collected. Thus, this makes such APIs as the ones mentioned in the article above a pretty powerful tool. Analyzing images and creating more metadata regarding the image and updating data storing appropriately to benefit the data analytical tools applied - will be very helpful in making better decisions shaping the future of people, companies, industries, and the world.

May the force be with you,
G2