✨ add group_id to webhook events

[ff137]

The acapy-wallet-groups and redis-events plugins were modified to be able to append the group_id to the webhook event metadata:

• ✨ add group_id to wallet settings acapy-wallet-groups-plugin#34
• ✨ add group_id to metadata aries-acapy-plugins#73

This PR updates to use those latest plugin releases, and updates the storage of transformed webhook events on redis to include the group_id in the redis key. This will allow us to query webhook events by group_id (in a follow-up PR).

Other amendments with this PR:

• ✨ group_id is now validated to be <= 50 characters long, and not contain certain special characters (not necessary as we enforce group_id's, but makes sense because we previously use group_id's in HTML query params and now in redis keys)
• ✨ ⚡ locked keys are now extended periodically in the AcaPyEventsProcessor + the EndorsementProcessor. This allows locks to exist as long as necessary.
• 🐛 ✔️ locks are no longer manually deleted after processing is finished. We may as well let them expire, because deleting them early could open them up to a replica that got the key in a scan result and is now trying to process it despite it being deleted.
• 📝 log levels updated in webhooks-service so no payloads are logged at info level -- only debug/trace + warning/error levels.
• 🎨 renamed cloudapi webhooks prefix from "cloudapi_events:" to "cloudapi:"
• ✨ added a match_keys method to the redis service, so we can match redis keys by wallet_id when the group_id is unkown. This is because group_id's are still optional in our ecosystem, and the SSE manager logic that is fetching events doesn't yet cater for fetching by group_id. Coming soon ™️

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
app
main.py	81	26	68%	74–77, 101, 103, 105, 109, 116, 142–147, 154–184
app/dependencies
acapy_clients.py	24	2	92%	36, 52
auth.py	56	19	66%	31, 37–38, 41, 52–55, 62–63, 68, 74–79, 83–86, 90–91, 96
role.py	34	1	97%	56
app/event_handling
sse_listener.py	41	8	80%	50–55, 79–84
websocket_manager.py	75	32	57%	32–38, 63–67, 86–89, 96–107, 114–124, 138
app/models
issuer.py	47	2	96%	34, 43
tenants.py	75	15	80%	93, 96, 105–115, 122, 125, 144–152
verifier.py	54	8	85%	30, 38–42, 79, 87–91
app/routes
connections.py	59	39	34%	25–39, 55–65, 79–93, 109–120, 139–146
definitions.py	237	97	59%	82–139, 172–173, 223–225, 241–247, 277–278, 307–308, 318, 372–373, 384–385, 422–426, 438–439, 446–454, 486–534, 558–559, 598–668, 676–695
issuer.py	173	38	78%	66, 97, 129–131, 164, 194–196, 204, 221, 320–330, 361–372, 405–436, 477, 490, 522
jsonld.py	62	49	21%	29–92, 103–141
messaging.py	21	9	57%	31–36, 56–63
oob.py	49	32	35%	26–65, 76–88, 112–122
sse.py	32	15	53%	37–43, 66–72, 99–107, 136–142, 173–184
verifier.py	145	32	78%	58–60, 65, 103–105, 110, 152, 160–162, 167, 201–205, 214–216, 245–247, 253, 286–288, 293, 323–325, 359–361
webhooks.py	16	4	75%	30–34, 53–57
websocket_endpoint.py	18	6	67%	17–18, 27–28, 38–41
app/routes/admin
tenants.py	150	120	20%	46–156, 165–189, 197–214, 224–234, 243–255, 265–305
app/routes/wallet
credentials.py	78	54	31%	31–40, 49–59, 68–78, 87–99, 110–122, 134–143, 152–162, 171–181
dids.py	75	22	71%	24–33, 50–51, 71–72, 84–91, 99–105
jws.py	39	26	33%	33–51, 67–85
sd_jws.py	39	26	33%	34–52, 69–87
app/services
acapy_ledger.py	69	18	74%	50–51, 77–79, 118–119, 132–151, 204–205
acapy_wallet.py	40	4	90%	61–62, 96–97
revocation_registry.py	153	76	50%	211–212, 222–224, 275–280, 304–325, 345–372, 396–431, 483–487, 510–564
sse.py	71	55	23%	20–24, 36–49, 62–75, 91–108, 125–142, 160–183
webhooks.py	27	18	33%	14–24, 31–39
websocket.py	44	34	23%	19–22, 29–36, 45–79
app/services/issuer
acapy_issuer_v1.py	90	13	86%	32, 59–82, 163–164
acapy_issuer_v2.py	102	21	79%	48–51, 71–105, 143, 189–190, 213
app/services/onboarding
issuer.py	38	6	84%	98–100, 117–119
tenants.py	62	48	23%	26–92, 102–132
verifier.py	36	3	92%	66, 82–86
app/services/onboarding/util
register_issuer_did.py	61	7	89%	85–87, 178–180, 195
set_endorser_metadata.py	69	37	46%	26–28, 46–48, 70–72, 103–120, 132–141, 153–164, 177–189
app/services/trust_registry
actors.py	107	9	92%	94–99, 109, 208–209, 211–216, 281–284
schemas.py	49	4	92%	56–61, 91–96
app/services/trust_registry/util
actor.py	31	2	94%	26–27
issuer.py	23	4	83%	39–40, 48–49
app/services/verifier
acapy_verifier_v1.py	133	68	49%	36, 59–63, 74, 96–100, 105, 113, 137–141, 146, 159–169, 174–176, 182–196, 200–219, 223–235, 239–259
acapy_verifier_v2.py	140	74	47%	40–45, 65–69, 81–86, 108–112, 117, 130–135, 149–153, 158, 171–183, 188–192, 198–212, 216–235, 239–253, 257–277
app/tests/admin
test_onboarding.py	86	1	99%	263
app/tests/e2e
conftest.py	21	5	76%	37–45
test_credentials.py	120	11	91%	96–130
test_jsonld.py	64	16	75%	133–168
test_tenants.py	280	15	95%	153, 197–198, 226, 558, 592–593, 602–603, 612–613, 625–626, 635–636
test_trust_registry_integration.py	63	1	98%	111
test_verifier.py	306	1	99%	37
test_wallet_dids.py	67	10	85%	92–107
app/tests/issuer
test_issuer.py	161	2	99%	293–296
app/tests/services
test_revocation_registry.py	87	5	94%	70, 116, 196, 240, 259
app/tests/util
ecosystem_connections.py	135	27	80%	276–295, 312–332, 340–377
ledger.py	49	10	80%	34, 42, 54, 62–66, 76, 82
member_acapy_clients.py	36	6	83%	47–50, 65–66, 73–74
trust_registry.py	41	3	93%	26, 29–30
webhooks.py	25	2	92%	13, 57
app/tests/verifier
utils.py	143	89	38%	174–188, 195–214, 226–263, 271–274, 280–291, 297–306, 311–364, 375–427, 440–466, 479–517, 531–569, 583–604, 615–631, 644–650, 664–680, 694–720
app/util
acapy_issuer_utils.py	18	1	94%	22
acapy_verifier_utils.py	134	82	39%	40, 48–126, 157, 164–183, 187, 194–198, 206–210, 214–218, 225–255, 261–264
credentials.py	10	4	60%	8, 12–15
retry_method.py	32	32	0%	1–101
tenants.py	25	13	48%	12–19, 34–35, 42–49
endorser
main.py	33	3	91%	59–62
endorser/services
endorsement_processor.py	138	13	91%	148–158, 191–195, 207, 219, 237–238, 247–251
endorser/services/dependency_injection
container.py	14	1	93%	54
endorser/util
endorsement.py	50	8	84%	55–56, 59–60, 63–67, 71–75
transaction_record.py	55	6	89%	51–52, 78–82, 95
trust_registry.py	34	4	88%	51–52, 63–67
trustregistry
crud.py	176	152	14%	15–30, 34–46, 50–62, 66–78, 82–141, 145–161, 165–194, 200–214, 218–228, 232–252, 256–283, 287–302
db.py	29	9	69%	11–15, 19–23
list_type.py	10	4	60%	9–12, 15
main.py	41	15	63%	23–32, 54–59, 64
trustregistry/registry
registry_actors.py	82	58	29%	19–22, 27–38, 45–65, 72–82, 89–99, 106–116, 121–127
registry_schemas.py	65	40	38%	24–27, 34–51, 58–92, 97–108, 113–119
webhooks/models
conversions.py	63	6	90%	70, 83, 89, 110, 145, 163
webhooks/services
acapy_events_processor.py	157	13	92%	151–161, 205, 233, 261–262, 286–290, 302–306
sse_manager.py	226	36	84%	153, 155–168, 202–212, 241–242, 255–269, 324–328, 334–337, 339–342, 367–368, 411–413, 447, 458–459
webhooks_redis_serivce.py	99	14	86%	61–64, 67, 122–123, 206–207, 267, 273–274, 288–294
webhooks/services/dependency_injection
container.py	18	1	94%	61
webhooks/tests
test_sse_manager.py	161	3	98%	212–213, 219
webhooks/tests/e2e
test_sse.py	81	4	95%	121, 147–150
webhooks/web
main.py	42	3	93%	77–80
webhooks/web/routers
sse.py	168	137	18%	34–38, 61–96, 121–154, 173–238, 260–301, 324–376
webhooks.py	30	14	53%	27–36, 50–63
TOTAL	10068	2063	80%

Tests	Skipped	Failures	Errors	Time
321	2 💤	0 ❌	0 🔥	11m 46s ⏱️