[$125] Create script for migrating "isApplicationPageActive" from CSV file

[maxceem]

Background

Recently we've added a new field to the Job Model isApplicationPageActive. This field in TaaS API reflects the same value in RCRM. We already have existent Jobs in RCRM, so we would have to sync values from RCRM to TaaS API for existent jobs.

Task

We should implement this script a similar way as we've implemented scripts/recruit-crm-job-import as per issue #101.

• Create a script inside scripts directory. I should have its own directory, which would contain:
  • index.js - the script itself to run
  • README.md - brief readme on how to run the script (which ENV vars to set and how to point CSV file)
• As we need to add data to both DB and ES, I guess the easier way would be make the script call TaaS API for creating jobs.
• We would have around 400 jobs in real data.
• Script should get all params as ENV variables (for example M2M token config for calling TaaS API) or anything else
• CSV file path should be provided as an argument.

CSV file example

task-isApplicationPageActive.csv.zip

Script workflow

• From the CSV file, only 2 fields needs to be used Allow Apply and Slug
• Mapping between TaaS API and CSV file values:
  • csv-file.Allow Apply = job.IsApplicationpageActive
  • csv-file.slug = job.externalId.

1. Read records in CSV file one by one
2. Search job.id by job.externalId
3. Update the job record by job.id
   • If Allow Apply = Yes, isApplicationPageActive = true
   • if Allow Apply = No, isApplicationPageActive = false

Script Logging

When the job is done show summary information about script work like this:

No. of records Read = 6
No. of records updated for field IsApplicationPageActive = true = 3
No. of records updated for field IsApplicationPageActive = false = 2
No. of records : ExternalId not found: x
No. of records failed : 1

List any error if any.

[maxceem]

Challenge https://www.topcoder.com/challenges/528ee50a-fe5c-42f5-a7b5-4b6d30c3bf51 has been created for this ticket.

This is an automated message for maxceem via Topcoder X

[maxceem]

@imcaizheng this issue is open for pickup.

[maxceem]

Challenge https://www.topcoder.com/challenges/528ee50a-fe5c-42f5-a7b5-4b6d30c3bf51 has been assigned to aaron2017.

This is an automated message for maxceem via Topcoder X

[imcaizheng]

PR created #174

[maxceem]

@nkumar-topcoder this is done and pushed to DEV.

You may run this script by following the README https://github.com/topcoder-platform/taas-apis/tree/dev/scripts/recruit-crm-job-sync.

Note, that this script requires ENV variables listed in file https://github.com/topcoder-platform/taas-apis/blob/dev/scripts/recruit-crm-job-sync/config.js. All the variables are prefixed by RCRM_SYNC_ if RCRM_SYNC_CONFIG_NAMESAPCE is not provided.