Azure – My IT Cheat Code

Open/Explore/Export ORC file

Cheat Codebigdata-file-viewer Today I need to explore some of the ORC file that has been loaded by someone to datalake. I can do my usual stun by creating external table on Hive and run my checking. So I was googling around and managed to reach to this tool. And I love it!Downloaded the latest releasedContinue reading “Open/Explore/Export ORC file”

Hive Drop Partition

Cheat CodeALTER TABLE mydatabase.mysupertable_agg DROP IF EXISTS PARTITION(month_partitionkey = ‘__HIVE_DEFAULT_PARTITION__’); Another amazing day.We have been almost 1 year with Hive as main big data engine, and everything was smooth as baby bum.This morning, out of the blue (why blue? I wonder)… my dashboard looks damn weird. I have strange month start appearing on the chart,Continue reading “Hive Drop Partition”

Azure SQL – Super fast string wildcard search with pagination

Cheat CodeIndex on column Today mission is to allow user to run super fast query on Azure SQL table.Not any kind of query, it’s a string search query… something like: The table is not too big, just 80 Millions rows (that’s freaking big actually).Why the query written that way is beyond this post (we needContinue reading “Azure SQL – Super fast string wildcard search with pagination”

Azure Bastion – How to Change Password/Send CTRL+ALT+DEL

Cheat CodePress CTRL+ALT+END Another day another story.We are using Azure Bastion to access our Windows VM, it’s a super cool service! Allowing users to RDP to VM without needing to open 3389 on firewall. And as of now like the rest of the world, most people are working from home. I don’t mind to getContinue reading “Azure Bastion – How to Change Password/Send CTRL+ALT+DEL”

Azure SQL – Where the heck is SQL Profiling?

Cheat Code (this is combo cheat, so pay attention!)> Azure SQL Audit + Blog Storage + XEL File + SSMS! I’m puzzled, cursing, banging my head, almost throw my laptop (lucky I didn’t do that, so bloody expensive if I did that – My company charge full laptop replacement to our paycheck if we brokeContinue reading “Azure SQL – Where the heck is SQL Profiling?”

Azure Data Factory working with “UCS-2 LE BOM” a.k.a “UTF-16LE with Signature” a.k.a “UTF-16” a.k.a “Windows Unicode”

Cheat CodeSet Encoding to “UTF-16” So we received this file on our blob and we need to convert it into ORC file for our hive to eat it fast n furious. Using the battle proven Azure Data Factory (ADF) we spin quickly a pipeline to read the blob data which is zipped and have tabContinue reading “Azure Data Factory working with “UCS-2 LE BOM” a.k.a “UTF-16LE with Signature” a.k.a “UTF-16” a.k.a “Windows Unicode””

Using CURL to get Microsoft Graph API

Cheat Codecurl -v -X GET -H “Authorization: Bearer ey[removed]” -H “Content-Type: application/json” https://graph.microsoft.com:443/v1.0/users?$filter=startswith(displayName,’someone’) –trace-time -v So I have web API hosted in Azure App Service which returning a result from Microsoft Graph API about some user. This API is somehow bloody slow… it took almost 8 seconds to return result.I’m puzzled! I want to knowContinue reading “Using CURL to get Microsoft Graph API”