Microsoft APAC Open Day @ Makati Shangri-La

20171129_123726.jpg I was invited by Microsoft to attend this event last November 29, 2017. The venue was Makati Shangri-La Hotel so I thought “Why not? The food will be great.” Did I know that this might be the single most blasphemous event I’d ever attend? No, and I was very surprised.

This slideshow requires JavaScript.

It is quite nice that Microsoft is finally embracing open source technologies. And I was really surprised that they will take it to this level (organizing grand events worldwide for open source techs). The statement is clear as the sunshine: “Microsoft ❤ Opensource”; and I don’t really know what more can the opensource purists say to deny this. Anyway, I am not quite fond with opensource stuff. True that opensource tech cannot be avoided and sometimes the business requirements dictates that I use opensource stuff, but I will still use Microsoft technologies as first choice if I ever had the choice to do so. I cannot deny that right now I am wondering that the IT Pros who invested their time and effort on Microsoft technologies think of what’s happening. But I am quite sure that the feedback of the opensource community is very positive. I always see opensource people in our tech group chatting about how good Visual Studio Code is.
20171129_153056.jpg

The Lounge

After the event, I met with a friend since highschool she’s a Communications Executive at Makati Shangri-La Hotel. She showed me around. The Gingerbread house is made with real ginger bread. The iconic sampaguita inspired chandelier is been there ever since the hotel has been established. Of course, the hotel experience is not complete if you didn’t climbed up and down the grand staircases. The food is excellent! My friend told me that the stereotype of hotel in the Philippines (You have to stay or you have to have a reservation or be attending an event in order to enter a hotel) is not necessarily true. A Hotel is like a big old fancy mall where you can enter, browse stuff for sale, eat, Umorder ng kape, damhin ang ambiance, tumambay, at maki wifi gaya ng ginagawa ko ngayon. I actually tried it out and the ambiance is very conductive to creative activity. The last picture is what I ordered, an exotic tiramisu and a cappuccino, Here’s a close up: 20171219_190744 I was doing a quick research on the history of Microsoft technical communities here in the Philippines, and I found out that they used to have DevDays here @ Makati Shangri-La. I guess excellent companies chose excellent event venues 🙂 I am very thankful to Aencille Santos for showing me around and breaking the stereotype of Hotels here in Philippines.

UE – Caloocan Computer Engineering Title Defense S.Y. 2017 – 2018

Being invited to be a panelist at any kind of defense is one of life’s sweetest treats. Pakiramdam ko para akong si kamatayan na gigilitan nalang yung mga nag dedefense sa harapan ko. This is the 3rd time I was invited in UE – Caloocan. Yung unang panel ko sa kanila is isang semester palang yung Thesis, so kung ano man ang ilatag sa harapan ko, yun na yun. I’ll just check the testing results with the scopes and limitations. Yung next na invite sakin is hindi pa ako ganung ka talas when it comes to judging the quality of the thesis. Now on my 3rd time palagay ko may hustisya naman.

Yung 2nd and 3rd time ko, hati na sa dalawa yung thesis subject nila. Thesis 1 which is the chapters 1-3 (Methods of Research) then yung Thesis 2 which is the implementation na nung project. So dito sa title defense, may palag pa sa scope and limitations. Wala pang masyadong effort na ibinubuhos sa pag gawa nung project kaya pwede pang i-istretch yung scope, at iistrike down yung limitation. But there are some select people na talaga namang maganda ang pagkakapili ng  topic and technologies na gagamitin kaya mejo na iimune doon sa pag stretch ng scope.

By my standards, the bare minimum of a Computer Engineering(CpE) Thesis should have elements of CpE’s fields of specialization:

  • Microelectronics
  • Embedded Systems
  • Software Development
  • System and Network Administration

Sa tagalog, dapat merong hardware(nakakagawa dapat sila ng sarili nilang circuit or atleast nakakapag combine sila ng shields/modules), dapat merong microcontroller (nakapag program dapat sila ng low level language), dapat merong software(nakapag program dapat sila ng high level programming) na nag i-interface sa database (nakapag persist dapat sila ng data), at dapat lahat ng iyan ay connected sa isa’t isa (Wifi, Bluetooth, or wired connection). Bahala na sila kung anong klaseng technology ang gusto nilang gamitin at kung ano ang purpose ng project nila basta dapat ma-meet yan.

After that the last key ingredient could either be feasibility, innovation, or community impact. At least isa sa tatlong yan. It’s either yang ginagawa mo is mas murang alternative sa existing solution or yang ginagawa mo is gumagamit ng masmakabagong technology compared sa existing solution, or sinusulusyonan mo ang isang problema na nakita mo sa local community mo.

20171008_133202.jpg

Here are the titles na ni-defense nila for this school year:

  1. Piezoelectric Staircase to produce Renewable Energy with SMS Monitoring System.
  2. Wireless Sign Language Translator.
  3. Bombastic Water Pump: An Automated Flood Control and Proactive Monitoring System in Navotas City.
  4. A Microcontroller Based Portable Forecasting Device and Tide Detection System in Baranggay Laiya San Juan Batangas.
  5. Smart Gardening Watering and Monitoring System with Solar-Powered Lighting.
20171008_103740.jpg

The proponents of the Wireless Sign Language Translator.

My personal favorite is #2, one of the proponents is a volunteer sign language interpreter in their church. They got someone close to the role of a ‘Domain Expert’. The only thing I find unpleasant in this group is that they preferred to use Microsoft Access as their database. They should’ve chosen something else like SQL Server or SQLite so that when the put this project on their resume they’ll be more marketable. We don’t really know yet if they’re gonna aim for word by word translation or letter by letter translation. the panelists simply assumed that they’ll go for word by word and end up (at least) in letter by letter translation. I’ve heard they’ll be using American standard of translation. I just forgot the exact term they used to describe that.

They could further improve this project by trying out Microsoft Text Translator APIs. The API cannot translate sign language but they can translate English to any other languages. There is also a Microsoft Speech Translator API. However, these things requires internet connection. Their current project does not depend on the internet. I would strongly suggest that they steer clear of the letter by letter translation since there already exist a Keyglove, their project sounds like a good contribution to this open source project though.

20171008_115848.jpg

The proponents of Bombastic Water Pump: An Automated Flood Control and Proactive Monitoring System in Navotas City

Running up would be #3, Their project has the potential to be a government project. for some odd reason, there are too many of them in a single group. so I’ve requested a Cost Benefit Analysis of their project as an addition to their documentation. This should help them in bidding if they ever chose to participate.

20171008_143917.jpg

The proponents of A Microcontroller Based Portable Forecasting Device and Tide Detection System in Baranggay Laiya San Juan Batangas

My least favorite will be #4. They are proposing some kind of a portable weather station. by the time that they gathered data they’ll connect it to a computer on HQ and use some kind of a forecasting model to predict the weather. And no, predicting the weather does not mean comparing with the actual weather. “Predicting the weather” means comparing their sensor’s value to the city/province average as provided by online websites. Their methods feels like those you encounter on a typical physics laboratory experiment.

Now why am I ranting about this. Basically X things:

  1. I’ve already encountered a project similar to them (a box of data-gathering sensors that can be moved anywhere).
  2. Their brand of forecasting doesn’t sound right.
  3. One of their limitation is that there won’t be any web-based interface or connection or some sort.
  4. This project has a lot of potential since it’s about data gathering and forecasting.

First of all, one of my friend submitted a thesis of similar device. but instead of weather related data gathering they are more focused on Air Quality. So their sensors are Gas Sensors + Temperature + Humidity + GPS and a Wifi Module so that their Device can throw the gathered data to the cloud, and from the cloud-based database, a they created a web interface featuring a Map Visualization of the gathered data. What #4 is offering is a device with Temperature + Humidity + Rain/Flow + Light Sensors… and that’s it! no GPS, no Wifi. They’ll just gather data and store it in the microcontroller until they reach the HQ where they could dump the data to their forecasting model.

2nd is that I don’t even know where they got enough data to do their own forecast! When we talk of forecasting, it means that you have gathered lots and lots and lots of data, and use those loads of data along with the present values to predict future values. In the context of weather, even if we are to assume that they can finish the project at this instant, data worth less than a year is not enough to do forecasting since there is seasonality in weather. What are they gonna do, get the provincial/city historical data and use it along with the present values?

3rd is that they used “Bad internet coverage” to justify the “no web interface” limitation. While everyone wants a piece of cloud, these guys decided to continue on the ground. But I can’t do anything about it because what they have stated might be true. Here in the Philippines internet connection is one of people’ greatest frustration.

Finally, what can they do to improve their thesis/project? What is the hidden potential in their project? One would be throwing out the limitation of internet connection, they’ll just have to find ways to connect one way or another. The connection does not need to be real time. They just need a way to throw the data to the cloud, and from the cloud they can use different stuff like Azure Machine Learning to do their weather forecast and Power BI Map Visualization. Their project is a potential use case for the Internet of Things, but it was dumbed-down by removing the ‘Internet’ from ‘Things’ hahaha! However, even with the power of cloud, they still don’t have a way to do decent forecasting since the time to gather the local weather data is not enough. Maybe if they will refine their title to predicting temperatures and humidity.

20171008_084643.jpg

The proponents of Piezoelectric Staircase to produce Renewable Energy with SMS Monitoring System

20171008_155101.jpg

Smart Gardening Watering and Monitoring System with Solar-Powered Lighting

I have neutral opinions on the other two. The renewable energy staircase has to demonstrate that they can achieve break-even power generation with their project (they have a microcontroller + GSM Module Load on top of what ever they want to power up). The other one about gardening sounded weird. I don’t really appreciate the benefit of automating your garden or detecting the soil nutrient from a flower pot. The only exception is when you are growing something expensive and delicate like Saffron or something. I don’t really see geeky gardeners in the near future right now. I mean, would you care to measure the exact concentration of fertilizer in the water and on the soil? No, you just put a teaspoon or two on your watering can and carry on with your chore or start telling stories to your flowers.

But who knows, I might be wrong right? We shall see on the day of judgement on 2018. I am very excited to see the progress on their projects. Honestly, pakiramdam ko ang kapal kapal ng mukha kong mag critic, gayong alam ko sa sarili kong hindi naman ganyang ka bongga yung Thesis namin noong mga panahon yun. Well I guess this is what they call progress. ibang iba na kase ang curriculum ng CpE ngayon compared noon. madaming subjects ang nadagdag at madaming subjects ang nabawas. pero ang summa total is ganun parin: Certified Product of Excellence.

On the lighter side, the I enjoyed being a panelist. I am able to mentor students and I am able to catch up with my professors and teachers. Napakaraming pagkain, nakakagulat nga kase pagkakaalam ko nag bayad na sila ng pampakain at honoraria for panelist, pero buhay parin yung tradition ng pagbibigay ng token of appreciation. Sayang wala si Mam Sim, nasa Korea siya nung mga paanhong yan.20171008_081041.jpg20171008_162255.jpg20171008_162514.jpg

The reason kung bakit sweet treat ang ma invite sa UE Caloocan as a panelist is because I can freely use my Engr. Title without having to explain myself. Hahahaha! Yung mga engineering students kase na walang board exam, instant engineer yang mga yan pag graduate. on the other hand, yung mga engineering students na may board exam, may batas na nag sasabihin hindi nila pwedeng gamitin yung title nila hangga’t hindi sila pumapasa sa PRC Board Exam.

Naaalala ko pa noong college days ko, the title is a big deal. I even considered na mag take ng Professional Computer Engineer Licensure examination abroad or doing double degree para kumuha ng ECE units at makapag board exam. Of course, now I know better. Sayang yung panahon na mag aaral ka pa ulit, why not jump into the conclusion: Do something that will contribute to the betterment of the society. Yan naman din kase ang guiding principle ng PRC kung bakit sila nag reregulate ng professions. O di kaya derecho trabaho nalang at nang makasweldo at makakain na ng mga pagkaing trip mong kainin! Hahaha!

Tsaka napakamahal mag maintain ng PRC License! Hahahaha! But seriously, I think kailangan mo lang kumuha ng lisensiya kapag ang profession mo ay may hinahandle ka na something that will put other people’s lives at risk. Kung ang profession mo eh hindi namang ganung ka critical, useless lang ang license. palamuti lang. ika nga nung isa kong prof, itapal mo sa noo mo kapag nanliligaw ka para malaman ng mga magulang na engineer ka. Kung alam niya lang, palagay ko mas effective ang payslip kaysa sa lisensiya. hahahaha!

LPU Cavite Tech Day – Data Visualizations with Power BI

Eventbrite URL: https://www.eventbrite.com/e/data-visualization-using-power-bi-tickets-38712899324

Eto na ata an pinaka fulfilling workshop na nagawa ko sa talambuhay ko. I taught them the basics and then gave them space for creativity, binigyan ko sila ng mapapagkunan ng data na gusto nilang paglaruan, and then Boom !! ayan! nakagawa sila ng sarili nilang PowerBI Reports. Nung nag lalaboy laboy ako sa room, madami akong nakikita mga makukulay at mga nagtangkang gumamit ng custom visuals. I’m quite sure that they were able to publish it on their free PowerBI Account. Pero etong tatlo lang ang brave enough to share they discoveries with the class.

Number of High-school Provincial Enrollment by Gender from Chriselle Molar: Chriselle Molar

Imports of the Department of Health from Daryl Nicolas: Daryl Nicolas

Philippine Provincial Election Results of 2016 from some random computer science student: Computer Science

Not bad for students with zero knowledge on Business Intelligence and the Context of the Data. I enjoyed their report and given them a little something in return for sharing what they’ve learned form that day. I’ll try to add a few posts regarding on how they could further improve their PowerBI Reports so stay tuned.

I would like to commend the efforts of those people behind the Open Data Philippines more power to you guys and hopefully more updated data para mas happy kaming mga data professionals.

Gallery

Recollection: PHISSUG S01E06 – Stretch Database

Stretch Database.png

This was my first-time demonstrating a technology that required Azure credits, I felt a bit pressured in getting it right before my azure credits run out. The demonstration turned out to be good from a technical perspective, but I am not quite sure on the business perspective.

The session started with a quick review of the problem that StretchDb is trying to solve, and then we went on with the demonstrations. There are a lot of screenshots on the presentation above that should get you through the whole process including examining the query execution plan when retrieving on-premise data and archived data.

Here is a quick summary of the presentation:

Slides 1-10: Business Case
Slides 11-20: Enabling StretchDb on Database
Slides 21-28: Configuring tables for stretching
Slides 29-43: Data movement from on-premise to cloud vice versa
Slides 44-49: Backup and Restore
Slides 50-51: Scaling on Cloud
Slides 52-56: Stretching Temporal Tables
Slides 57-68: Stretching of tables with always encrypted enabled
Slide 69: Pricing
Slides 70-77: Pausing and Disabling StretchDb

Status

Connecting PowerBI on Office365 to OneDrive for Business

User Story

First of all I would like to give a special thanks to Programmers, Developers for letting me use one of their accounts for PowerBI Publishing and saving data source in their OneDrive for Business.

I made this in response to a question during my talk on Usapag Ulap on Azure last January 21, 2017. It was an impromptu question regarding connecting to OneDrive for Business but I guess you can also use this to connect to OneDrive Personal. I see this question worthy of a blog post because you can create an excel survey and visualize the survey results using PowerBI, and schedule the dataset refresh so that the results will be updated every now and then.

Getting Started

  • This blogpost assumes that you attended Usapang Ulap.
  • Hence you know how we connected to OneDrive for Business
  • Hence you know that our Report has Open and Closed Issues
  • Hence you know that we tried to verify that the report is refreshing by changing the Closed items into Open Items.

Getting Things Done

  1. After creating your PowerBI Report (with the source file pointed on the OneDrive for business) and publishing it to office 365. You will encounter this error: “The credential stored in the cloud is missing.”

     

    The dreaded credential error.

    This error means that PowerBI could not connect to OneDrive for Business because it cannot use the credentials you supplied on PowerBI Desktop because these credentials stays on the computer.

  1. In order to correct this, Click the ellipsis on the right of your PowerBI Dataset name. and click Schedule Refresh


  2. You will be brought to a page where you can change the settings for your dataset, expand the Data Source Credentials and click Edit Credentials.

  3. You will be prompted to configure the authentication method of the data source, on the dropdown menu choose OAuth2 and click the Sign In button.

  4. An Office365 sign in page will pop up, choose the account that you use to sign in to OneDrive for Business login with it.

  5. A pop up on the top right corner of the screen will verify that you’re successful with the configuration.

  6. You may now proceed to refreshing your dataset.

    Before Refresh:


    After Refresh: