Ambari -> YARN -> Advanced -> yarn.admin.aclAdd the user
Category Archives: Uncategorized
Powershell – Open Large CSV and skip few lines
Cheat CodeGet-Content .\MyDamnJumboFile-20200906-172617.CSV | Select-Object -skip 852115 -first 10 | Out-File Output.txt
Open/Explore/Export ORC file
Cheat Codebigdata-file-viewer Today I need to explore some of the ORC file that has been loaded by someone to datalake. I can do my usual stun by creating external table on Hive and run my checking. So I was googling around and managed to reach to this tool. And I love it!Downloaded the latest releasedContinue reading “Open/Explore/Export ORC file”
DBeaver – Use Space instead of TAB
Cheat CodeWindows -> Preferences -> General -> Editors -> Text Editor -> Insert spaces for tabs Your welcome!I’ve been pulling my hair lately because when I try to get view definitions of our hive views, the definition is screwed. Some part of the view definition are truncated.Apparently if you have more than 1 level indentContinue reading “DBeaver – Use Space instead of TAB”
DBeaver – Hive connection keep disconnecting
Cheat CodeSET Keep-Alive settings to 60 seconds I love DBeaver! It’s a GUI tool to run queries and connect to various databases. One of the reasons I really like this tool is because they can auto discover driver required to connect to our databases (Hive, SQL, Drill, yada yada.. you name it!) and download itContinue reading “DBeaver – Hive connection keep disconnecting”
Hive Rename Table
Cheat CodeALTER TABLE mydatabase.fact_transaxion RENAME TO mydatabase.fact_transaction One thing I really hate dealing with various project is TYPO ERROR.How the hell the developers anyhow type and deploy table to database without double checking the name. ARGH! Luckily it’s pretty straight forward to rename the table in HIVE. Use the cheat code above to rename it.SimpleContinue reading “Hive Rename Table”
Hive Drop Partition
Cheat CodeALTER TABLE mydatabase.mysupertable_agg DROP IF EXISTS PARTITION(month_partitionkey = ‘__HIVE_DEFAULT_PARTITION__’); Another amazing day.We have been almost 1 year with Hive as main big data engine, and everything was smooth as baby bum.This morning, out of the blue (why blue? I wonder)… my dashboard looks damn weird. I have strange month start appearing on the chart,Continue reading “Hive Drop Partition”
PowerBI – Switch Measures Dynamically
Cheat CodeSelected = if( HASONEVALUE(‘Currency Switcher'[Currency]), SWITCH( VALUES(‘Currency Switcher'[Currency]), “Local”,sum(fact_order[CostLocalCurrency]), “USD”,sum(fact_order[CostUSD]))) Simple!Enuf say… Everyday I’m shufflin’ with PowerBIalways new things to learn… Too many copy of dashboard/report just to switch couple of measures. I’m lazy and I dont like repetitive task. KISS Yo! Keep It Simple and Stupid. Have Fun!
PowerBI – Count Dimension by other dimension linked by fact
Cheat CodeCountTargetRows = CALCULATE( DISTINCTCOUNT(dim_TargetDimension[TheColumnName]), FILTER(dim_middle_man, CALCULATE(sum(FT_Transaction[Cost])>0))) Love-Hate relationship with PowerBI! I love the product as it’s super powerful BI tool, not to mention CHEAP (it’s free as matter of fact – PowerBI Desktop). It can do magic and wonder. Today I was asked how to create calculation for count of dimension rows but it’sContinue reading “PowerBI – Count Dimension by other dimension linked by fact”
Want to take screenshot and auto save it to disk so you don’t miss it?
Cheat CodeGreenshot! I need to take screenshit… I mean Screenshot, and alot of them for whatever reason I can think of.Been using Windows buildin tool Snipping Tool, it’s super convenient to use it. My muscle memory on hands know it best (Windows Key + “SN”) then KACHA! Screenshot taken.The problem is, i need to pasteContinue reading “Want to take screenshot and auto save it to disk so you don’t miss it?”
My IT Cheat Code 