Dont add extra deps for providers with same cross provider deps

[amoghrajesh]

closes: #44195

After changes:

deps is ['apache-airflow-providers-common-sql']
extras is  {'amazon': ['apache-airflow-providers-amazon'], 'common.sql': ['apache-airflow-providers-common-sql'], 'openlineage': ['apache-airflow-providers-openlineage']}
EXTRAS ARE {'amazon': ['apache-airflow-providers-amazon>=2.6.0'], 'openlineage': ['apache-airflow-providers-openlineage']}

---

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

[amoghrajesh]

@potiuk @eladkal @gopidesupavan can you take a look when you have some time?

[amoghrajesh]

@potiuk @gopidesupavan i handled it using the requirements parser, its much cleaner now!

[gopidesupavan]

cool :)

[potiuk]

Interesting error. The "get_install_requiresments" is probably not the best idea to use because it adds escaping to " which is needed to produce "pyproject.toml".

dependencies = [
{{- INSTALL_REQUIREMENTS }}
]

Instead you should just use PROVIDER_DEPENDENCIES.get(provider_id)["deps"] @amoghrajesh - that one returns unescaped dependencies.

(and we do not need to us version suffix - this one is merely used to filter out extras - so version suffix does not matter).

[potiuk]

Maybe worth to add a comment in get_install_requirements that it escapes the dependencies :).

[amoghrajesh]

Interesting error. The "get_install_requiresments" is probably not the best idea to use because it adds escaping to " which is needed to produce "pyproject.toml".

dependencies = [
{{- INSTALL_REQUIREMENTS }}
]

Instead you should just use PROVIDER_DEPENDENCIES.get(provider_id)["deps"] @amoghrajesh - that one returns unescaped dependencies.

(and we do not need to us version suffix - this one is merely used to filter out extras - so version suffix does not matter).

Oh i see, let me correct that!

[amoghrajesh]

@potiuk the tests expect a version suffix, do we need it or not at all?

[amoghrajesh]

@potiuk i removed the version_suffix related changes. I will do it in a follow up