thailand-budget-pdf2csv

Let's create a tool to convert Thailand Government Budgeting from PDF to CSV!

รวมพลัง Dev แปลงงบ จาก PDF สู่ Machine-readable

เพื่อการตรวจสอบงบประมาณแผ่นดินที่ง่ายมากขึ้น

Usage

PDF -> TXT

You can download the results and see the source code in each approach under ./txt-extraction folder, or, just download output files from shortcut links below:

• tee4cute-gcloud-vision: Google Drive folder.

TXT -> CSV

You can download the results and see the source code in each approach under ./csv-extraction folder, or, just download output files from shortcut links below:

• napatswift-coordintes: Google Drive folder.

Translations

English version

• napatswift-coordintes (partially translated using Google Translation API): Google Sheet, see @asiripanich's repo for code.

Let's Code!

Download source budget PDF files from budget-pdf (เล่มขาวคาดแดง) and do some secret magics to generate output csv files with exepcted format below:

Expected Output Format (V2)

Note: Please see output example in output_example_vx.xlsx and output_example_vx.csv at repository root.

Release Notes

29 Jul 2021

• Send messages to DEBUG_LOG to cleary inform user about the source of error where it was orignated from: Syntactic Error or OCR Error.
  • Invalid CATEGORY_LV1 values will be reported in DEBUG_LOG as follows: "CATEGORY_LV1 is not as described". issue#15-comment
  • Invalid AMOUNT values will be reported in DEBUG_LOG as follows: "AMOUNT FORMAT IS WRONG".

25 Jul 2021

• Fix some of Syntactic Errors reported by issue#15.
• Fix Compiler Error for wrong AMOUNT output on obliged item written in "XXXX - YYYY ZZZZ บาท" format.
  • For example, if the obliged entry is written as "2562 - 2564 30,000,000 บาท", the output will be:

      2562    10,000,000
      2563    10,000,000
      2564    10,000,000
    

    instead of

      2562    30,000,000
      2563    30,000,000
      2564    30,000,000
    

• Sending OCR Error reported by issue#11 to DEBUG_LOG to make it clear that the error was originated from the OCR Tool and needed to be cleaned by hand.

21 Jul 2021

• First version release

• You can download the first version in CSV format here.

Powered by This Dataset

• Budget Overview by korlan rayong

  https://public.tableau.com/app/profile/korlan.rayong2953/viz/OverviewBudget65/Dashboard1

  

• 2022 Thai Budget Structure by Thanawit Prasongpongchai

  Visualization: https://taepras.github.io/thaibudget65 Repository: https://github.com/taepras/thaibudget65

  

Talk

"ก้าวGeek Community", Line Group: http://line.me/ti/g/STUxfMX87U