Responsibilities

  • Backend developer working on our data collection effort to onboard raw data from vendor side and localizing them.
  • Implement and maintain software that interface with external vendors to bring in new data sets while implementing the rules and procedures that ensure integrity of the datasets.
  • Monitor the production environment of data onboarding and ETL process

Skills & Requirements

  • Statistics:
    • Not required, nice to have.
  • Database:
    • Have worked with one of relational database systems like: MySQL, PostreSQL, Oracle, MS SQL etc…
    • Understand and able to write complex database queries: SELECT statements with joining multiple tables, using aggregate functions, sub/nested queries, view etc…
  • Programming knowledge:
    • Able to write C++ is a plus.
    • Able to write Perl is a plus (will be trained)
    • Work well with Python: basic I/O, networking, numpy, pandas v.v…
    • Good programming logic with good knowledge of basic data structures, algorithms.
  • Linux experience:
    • Everyday work is on Linux command line, so candidate needs to be familiar with Linux command line, able to work with basic utilities from command line to do file handling like: cp, mv, grep, more, less, tail, cat, sed, vi/vim, input/output redirection etc…
    • It’s very nice if candidate has experience with perl or awk programming at basic level.
    • Has basic scripting programming skills (bash/shell scripting): basic instructions like switch, if/else, for, while, basic operations, comparisons, able to work with file, array etc…
    • Able to do troubleshooting like checking memory, OS info, CPU info, process info, logs, run/kill processes…
  • English:
    • Read/Write, Understand English well: English is used everywhere.
    • Listening, Speaking: basic