Docker Regression Tests Github action

[agunapal]

Description

This PR creates a github action to build TorchServe Docker Images and run regression tests inside a docker container

To make this happen,

• Create a new target for building docker ci image
• Some of the tests don't run as is inside the container. These need to be fixed. Skipping them for now
• Run docker regression tests nightly as they take longer to run. Each run takes around 1.5 hours

Fix these Pytests

• Update pytest test_torch_compile to make it work with docker regression test #2460
• Update pytest test_example_intel_extension_for_pytorch to make it work in docker container #2461
• Update pytest test_handler to make it work in docker container #2462

Fixes #(issue)

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• New feature (non-breaking change which adds functionality)
• This change requires a documentation update

Feature/Issue validation/testing

2_docker-regression (self-hosted, regression-test-gpu).txt
1_docker-regression (ubuntu-20.04).txt

Checklist:

• Did you have fun?
• Have you added tests that prove your fix is effective or that this feature works?
• Has code been commented, particularly in hard-to-understand areas?
• Have you made corresponding changes to the documentation?

[codecov]

Codecov Report

Merging #2403 (14f6139) into master (2f5a784) will not change coverage.
The diff coverage is n/a.

❗ Current head 14f6139 differs from pull request most recent head b126b2e. Consider uploading reports for the commit b126b2e to get more accurate results

@@           Coverage Diff           @@
##           master    #2403   +/-   ##
=======================================
  Coverage   71.89%   71.89%           
=======================================
  Files          78       78           
  Lines        3654     3654           
  Branches       58       58           
=======================================
  Hits         2627     2627           
  Misses       1023     1023           
  Partials        4        4           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[msaroufim]

Approved assuming CI is green on those images - for the failing test tracker please create a seperate github issue

[namannandan]

Nit: Why do we need the || true part? Does this command fail in certain conditions and we want to ignore it?

[agunapal]

Yes, there are weird permission issues because of pycache geenrated by docker run. This logic worked for me. Will have to monitor the runs for the next few days

[namannandan]

Nit: Would it be better check for the specific GPU runner attributes/labels instead of absence of ubuntu?

[agunapal]

I tried, the problem is that we need to check for the entire thing: [self.hosted, ...] . I couldnt get it to work , hence went for the negation logic.

Re-requested review after new changes. GitHub doesn't seem to reflect it.