Integrate EMSI for Job Desc. Parsing

[wdprice]

We now have a license for EMSI and can integrate it into this tool.

It will require building a map to be used temporarily to map EMSI results back to Topcoder skills. Create and integrate the mapping solution so that EMSI handles the parsing.

[nikolay83]

Who will provide this mapping?

[yoution]

@nikolay83 how about this one? How to do the mapping?

[nikolay83]

@wdprice @urwithat
could you please help?

[wdprice]

I'd like to have community members do it. The Topcoder Skill List and EMSI skills are both publicly available. Create the first draft mapping as a task/challenge.

[nikolay83]

So @yoution the flow will be as follows.

1. Parse a JD by EMSI to identify EMSI skills
2. Identify TC skills by the EMSI skills found.
3. Also don't forget the TC skills matching to more than 1 EMSI skill

Matching:
for those TC skills without a match, please

1. manually find synonyms/duplicates - e.g. Angular, AngularJS, Angular.js: let's see how many of them there are.
2. for those without duplicate please add some generic context and run them through EMSI again, e.g. "We are looking for a Swift developer" instead of just "Swift".

[yoution]

@nikolay83 for the unmatched skill, I have tried many times, I think EMSI doesn't not support these skills
curl --location --request POST 'https://api.topcoder-dev.com/v5/contest-tagging/emsi/internal_no_refresh' \ --header 'Accept: application/json' \ --header 'Content-Type: application/x-www-form-urlencoded' \ --data-urlencode 'text=We are looking for a Swift developer' \ --data-urlencode 'extract_confidence=true'
you can run this command in the terminal directly, swift can not match swift skill

[nikolay83]

@yoution
also if there are many skills (like Swift) not recognized by EMSI, we should parse a JD once again with our custom parser and then merge the derived skillsets.

[nikolay83]

@yoution
I deployed the PR. Skills like react or angular are not detected, even though our TC custom parser did find them.

[yoution]

@nikolay83 please merge the new pr, I just only fixed angular detection, if you input react, it will not match reactjs, you must input reactjs or react.js can match reactjs

[wdprice]

@nikolay83 - Swift is an EMSI Skill: https://skills.emsidata.com/skills/KSR5V7LNG1DL3C5O790P

Let's pay for work completed to date and put this on hold for now. We will resume after a this release and some net new fixes come out.