Refresh Hive Partition

Cheat Code
MSCK REPAIR TABLE mydatabase.table_name

We added partitions to our external table to manage our data easily. Multiple folders are set on our data lake.
How can we refresh the hive to know new partitions are added?

Quite Simple!

run the cheat code above and voila the hive partition is updated!
don’t worry it wont messed up your dataset.
I was afraid running the above statement in the beginning, but now… WHACK! just run it!

Published by Feivel

We love to travel!

Leave a comment

Design a site like this with WordPress.com
Get started