[$150] Investigate and fix performance

[jmgasper]

@atelomycterus - We now have Tideways deployed and working in prod, thanks! Can you have a look and see if there are any quick fixes we can do to help with performance? I'm happy to adjust the payment up if we run into tricky issues, thanks.

[jmgasper]

Challenge https://www.topcoder.com/challenges/9fffbcc9-590f-4890-abde-800c9ce3c826 has been created for this ticket.

This is an automated message for ghostar via Topcoder X

[jmgasper]

Challenge https://www.topcoder.com/challenges/9fffbcc9-590f-4890-abde-800c9ce3c826 has been assigned to obog.

This is an automated message for ghostar via Topcoder X

[atelomycterus]

@jmgasper Yes, sure. Keep you updated.

[atelomycterus]

@jmgasper Please see attached Tideways Report. While waiting for your feedback, I am working on #475. Let me know which issues from the report should be fixed first. Thanks!

[jmgasper]

@atelomycterus - I think the easiest place to start would be to see if we can update the memcache without first invalidating the data set. That way there's always data in the memcache, even if it may be slightly out of date.

[atelomycterus]

@jmgasper Yes, sure. We can do the following:

• Topcoder user data (Topcoder userId, handle, roles, pic url, rating). We can set 1 week or another value for it and update it from jwt token when user signs in. The Topcoder rating is only missing in jwt payload. The rating is recalculated after the end of the challenge, the expiration time can be set as the average duration of the challenge. Please correct me if I am wrong.
  Users who do not visit the Vanilla site, have not posted any content and are not members of groups will be removed from the cache automatically.
  Jwt payload:
  

• Role resources. Set default Memcached expiration time (3hours) or 1 day. I think that it is not updated often. Please correct me if I am wrong.

• Challenge role resources. Topcoder handles with challenge roles are displayed for Challenge forums. When
  /group/XXX/unarchive => add Challenge role resources in cache, set expiration time to endDate or endDate +1 day,
  If it is requested again then set a default Memcached expiration time.

Let me know your feedback.

[jmgasper]

1. Yes, this is fine. We can have the rating lag slightly without issue, I think, if it helps with performance.
2. Yeah, roles shouldn't be updated often, and if this becomes a problem we can design something in the API to update specific users manually
3. Yep, this sounds good.