Cheat CodeSet Encoding to “UTF-16” So we received this file on our blob and we need to convert it into ORC file for our hive to eat it fast n furious. Using the battle proven Azure Data Factory (ADF) we spin quickly a pipeline to read the blob data which is zipped and have tabContinue reading “Azure Data Factory working with “UCS-2 LE BOM” a.k.a “UTF-16LE with Signature” a.k.a “UTF-16” a.k.a “Windows Unicode””
Tag Archives: Troubleshooting
List all partitions from Hive Table
Cheat Code> show partitions database_name.table_name I was asked to list all partitions for the transaction hive table because somehow the number are not complete, so I ran the above cheat code to check all date partitions on my transaction tables.Simple right!? Once we found the missing partitions, we can just simple reload it from ourContinue reading “List all partitions from Hive Table”
Finding SQL Server Object Dependency
Cheat CodeSELECT * FROM sys.sql_expression_dependencies This is continuation from previous blog post about my “special project” that requires us to find there the heck some object are depends on and who use them.Using the cheat code above is a fantastic breeze to find how things are wired.Give it a kick and you will find aContinue reading “Finding SQL Server Object Dependency”
How to check Network MTU
Cheat Codeping http://www.google.com -f -l 1472 So we have issue with network connectivity that intermittently experiencing slowness (God, no one love slow network!). After checking around we found that likely it’s due to MTU settings not optimized. First is we need to check what’s the MTU set by our router (usually it’s 1500 btw). SoContinue reading “How to check Network MTU”
Using CURL to get Microsoft Graph API
Cheat Codecurl -v -X GET -H “Authorization: Bearer ey[removed]” -H “Content-Type: application/json” https://graph.microsoft.com:443/v1.0/users?$filter=startswith(displayName,’someone’) –trace-time -v So I have web API hosted in Azure App Service which returning a result from Microsoft Graph API about some user. This API is somehow bloody slow… it took almost 8 seconds to return result.I’m puzzled! I want to knowContinue reading “Using CURL to get Microsoft Graph API”
Digging the .ETL file – network packets file for TCP connection
Cheat CodeTCP.port==1433 So we have .ETL file from previous netsh session, what can we do with it?I installed Microsoft Network Monitor 3.4 (download here) – Microsoft why Archive such amazing tool!? 😦 –Once it’s installed I launch itThen the usual File -> Open -> Capture… and select the .etl fileSet the “Parser Profile” Once that’sContinue reading “Digging the .ETL file – network packets file for TCP connection”
Capture Network Packet without Wireshark
Cheat Code> netsh trace start persistent=yes capture=yes tracefile=c:\temp\capture.etl > netsh trace stop There are too many time we need to troubleshoot issue all the way to network level.Unable to connect, strange application error, etc.Nothing beats the capturing network packets to know at the lowest level.Use the above cheat code to capture the packet for analysis.NextContinue reading “Capture Network Packet without Wireshark”