Troubleshooting – My IT Cheat Code

HDInsight – Allow other user to see full entry on TEZ View

Ambari -> YARN -> Advanced -> yarn.admin.aclAdd the user

Open/Explore/Export ORC file

Cheat Codebigdata-file-viewer Today I need to explore some of the ORC file that has been loaded by someone to datalake. I can do my usual stun by creating external table on Hive and run my checking. So I was googling around and managed to reach to this tool. And I love it!Downloaded the latest releasedContinue reading “Open/Explore/Export ORC file”

Hive Rename Table

Cheat CodeALTER TABLE mydatabase.fact_transaxion RENAME TO mydatabase.fact_transaction One thing I really hate dealing with various project is TYPO ERROR.How the hell the developers anyhow type and deploy table to database without double checking the name. ARGH! Luckily it’s pretty straight forward to rename the table in HIVE. Use the cheat code above to rename it.SimpleContinue reading “Hive Rename Table”

Hive Drop Partition

Cheat CodeALTER TABLE mydatabase.mysupertable_agg DROP IF EXISTS PARTITION(month_partitionkey = ‘__HIVE_DEFAULT_PARTITION__’); Another amazing day.We have been almost 1 year with Hive as main big data engine, and everything was smooth as baby bum.This morning, out of the blue (why blue? I wonder)… my dashboard looks damn weird. I have strange month start appearing on the chart,Continue reading “Hive Drop Partition”

Linux – List Folder Size, sort it, and display in human readable format

Cheat Code du -h | sort -hr As usual something disturbing my lovely day.There’s a notification sent to my usually empty mailbox.And it said “Low Disk Space” on one of my Linux server named “LOVELY”. Then I think “That’s no way it can happen… I shower the server with lots of LOVE”, sigh…Okay time toContinue reading “Linux – List Folder Size, sort it, and display in human readable format”

Azure Bastion – How to Change Password/Send CTRL+ALT+DEL

Cheat CodePress CTRL+ALT+END Another day another story.We are using Azure Bastion to access our Windows VM, it’s a super cool service! Allowing users to RDP to VM without needing to open 3389 on firewall. And as of now like the rest of the world, most people are working from home. I don’t mind to getContinue reading “Azure Bastion – How to Change Password/Send CTRL+ALT+DEL”

Azure SQL – Where the heck is SQL Profiling?

Cheat Code (this is combo cheat, so pay attention!)> Azure SQL Audit + Blog Storage + XEL File + SSMS! I’m puzzled, cursing, banging my head, almost throw my laptop (lucky I didn’t do that, so bloody expensive if I did that – My company charge full laptop replacement to our paycheck if we brokeContinue reading “Azure SQL – Where the heck is SQL Profiling?”

Windows 10 – Start menu search not working

Cheat CodeREG ADD HKCU\Software\Microsoft\Windows\CurrentVersion\Search /v BingSearchEnabled /t REG_DWORD /d 0 REG ADD HKCU\Software\Microsoft\Windows\CurrentVersion\Search /v CortanaConsent /t REG_DWORD /d 0 tskill searchui Another blunder of Microsoft… My laptop start menu search function was stop working, I can’t search anything using the box.Apparently according to the article it’s due to Bing integration (Thanks Microsoft for giving meContinue reading “Windows 10 – Start menu search not working”

User can’t connect to hive with Kerberos because of http header size too big

Cheat CodeAmbari-> Hive -> Custom hiveserver2-site hive.server2.thrift.http.request.header.size=65536 hive.server2.thrift.http.response.header.size=65536 Our Azure HDInsight is secured with Enterprise Service Package/ESP (a fancy name saying the cluster is join domain to AD for authentication). Some of the users said they are having difficulties trying to logon from their beloved, most powerful, most flexible BI tool – Excel. After troubleshootingContinue reading “User can’t connect to hive with Kerberos because of http header size too big”

Your Hive Query Run Slow? This cheat make it faster!

Cheat CodeANALYZE TABLE mydb.mySuperPartitionedTable PARTITION (filedate) COMPUTE STATISTICS; ANALYZE TABLE mydb.mySuperBigFlatTable COMPUTE STATISTICS; I have couple queries running bloody slow, I mean REALLY darn slow!I ran over ODBC, JDBC, Beeline,… what ever you name it.. slow!then I have a look at the execution (oh it’s LLAP + TEZ should be freaking fast, right!?).I found strangeContinue reading “Your Hive Query Run Slow? This cheat make it faster!”