Hive: Add partitions for existing folder structure

Use msck repair table command:

MSCK [REPAIR] TABLE tablename;

or

ALTER TABLE tablename RECOVER PARTITIONS;

if you are running Hive on EMR.

Read more details about both commands here: RECOVER PARTITIONS

Related Contents:

  1. How does Hadoop process records split across block boundaries?
  2. What is the difference between partitioning and bucketing a table in Hive ?
  3. Difference between Hive internal tables and external tables?
  4. Name node is in safe mode. Not able to leave
  5. How to transpose/pivot data in hive?
  6. How does Hadoop Namenode failover process works?
  7. how many mappers and reduces will get created for a partitoned table in hive
  8. How to fix corrupt HDFS FIles
  9. Sqoop import : composite primary key and textual primary key
  10. How to delete and update a record in Hive
  11. Hive unable to manually set number of reducers
  12. How to load data to hive from HDFS without removing the source file?
  13. Spark iterate HDFS directory
  14. Default Namenode port of HDFS is 50070.But I have come across at some places 8020 or 9000 [closed]
  15. How does Hadoop perform input splits?
  16. Loading Data from a .txt file to Table Stored as ORC in Hive
  17. Hadoop: …be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and no node(s) are excluded in this operation
  18. Write to multiple outputs by key Spark – one Spark job
  19. Hive: Best way to do incremetal updates on a main table
  20. Failed to locate the winutils binary in the hadoop binary path
  21. merge output files after reduce phase
  22. Read whole text files from a compression in Spark
  23. Write a file in hdfs with Java
  24. How to control partition size in Spark SQL
  25. How to optimize partitioning when migrating data from JDBC source?
  26. What is the purpose of shuffling and sorting phase in the reducer in Map Reduce Programming?
  27. How to open/stream .zip files through Spark?
  28. How do I output the results of a HiveQL query to CSV?
  29. hadoop map reduce secondary sorting
  30. Is it better to use the mapred or the mapreduce package to create a Hadoop Job?
  31. Chaining multiple MapReduce jobs in Hadoop
  32. Permission denied at hdfs
  33. There are 0 datanode(s) running and no node(s) are excluded in this operation
  34. Create Table in Hive with one file
  35. How to create n number of external tables with a single hdfs path using Hive
  36. java.lang.NoClassDefFoundError: org/apache/hadoop/fs/StorageStatistics
  37. Apache Spark: The number of cores vs. the number of executors
  38. How to Access Hive via Python?
  39. The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw- (on Windows)
  40. data block size in HDFS, why 64MB?
  41. Pyspark: get list of files/directories on HDFS path
  42. Apache Hadoop Yarn – Underutilization of cores
  43. How to access s3a:// files from Apache Spark?
  44. How to access s3a:// files from Apache Spark?
  45. Where are logs in Spark on YARN?
  46. Is it better to have one large parquet file or lots of smaller parquet files?
  47. Hadoop speculative task execution
  48. Parallel Algorithms for Generating Prime Numbers (possibly using Hadoop’s map reduce)
  49. How do I Combine or Merge Small ORC files into Larger ORC file?
  50. Merging multiple files into one within Hadoop

Leave a Comment