This repository has been archived by the owner on Jan 5, 2022. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 1
Working with localstack
Peter Mangiafico edited this page Nov 7, 2018
·
2 revisions
see https://github.com/sul-dlss-labs/rialto-dev/
NOTE: some of this documentation has been adapted from https://lobster1234.github.io/2017/04/05/working-with-localstack-command-line/
- SNS Message Queue
- ES domain
- Lambda Function (to read message queue)
- The code and README in https://github.com/sul-dlss/rialto/pull/103
bash-3.2$ awslocal sns list-topics
{
"Topics": []
}
bash-3.2$ awslocal sns create-topic --name test-topic
{
"TopicArn": "arn:aws:sns:us-east-1:123456789012:test-topic"
}
bash-3.2$ awslocal sns list-topics
{
"Topics": [
{
"TopicArn": "arn:aws:sns:us-east-1:123456789012:test-topic"
}
]
}
AWS_ACCESS_KEY_ID=999999 AWS_SECRET_ACCESS_KEY=1231 aws es \
--endpoint-url=http://localhost:4578 create-elasticsearch-domain \
--domain-name records \
--elasticsearch-version 6.2 \
--elasticsearch-cluster-config InstanceType=t2.small.elasticsearch,InstanceCount=1 \
--ebs-options EBSEnabled=true,VolumeType=standard,VolumeSize=10
Note: The topic-arn is the value from above
awslocal sns subscribe \
--topic-arn arn:aws:sns:us-east-1:123456789012:test-topic \
--protocol lambda \
--notification-endpoint arn:aws:lambda:localstack:000000000000:function:f1
awslocal sns publish --topic-arn arn:aws:sns:us-east-1:123456789012:test-topic --message 'Test Message!'
curl http://localhost:4571/records/_search
The output should look like:
{"took":3,"timed_out":false,"_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":2,"max_score":1.0,"hits":[{"_index":"records","_type":"item","_id":"AWQaLSPcX7BG1AsnTYKW","_score":1.0,"_source":{"foo": "bar -- Test Message!"}},{"_index":"records","_type":"item","_id":"AWQaJQRQX7BG1AsnTYKU","_score":1.0,"_source":{"foo": "bar"}}]}}
- RIALTO Wiki Homepage
- RIALTO Use Cases
- RIALTO Architecture
- RIALTO Data Models
- RIALTO Acceptance Criteria
- RIALTO Data Sources
- Demo Videos
- Neptune/λ Integration
- Core/Combine Integration
- SPARQL Proxy λ
- Derivatives λ
- Entity Resolver Service
- Rebuild Trigger Task
- Solr Setup
- Ingest Service
- Combine Data Sources
- Data Mappings
- Load Procedure
- Starting & Monitoring ETL
- Counting # of Publications
- Jena/TDB vs Blazegraph
- Vitro Ingest Options
- VIVO/Vitro Assessment
- VIVO Community Convo Notes
- Vitro vs Stand-Alone Datastore
- Provisioning a VM
- Deployment Process
- Toggle inferencing
- Check Inferencing is On
- Recompute inferences
- Toggle indexing
- Working with Vitro Solr
- Vitro Solr Samples
- Ingest via Fuseki SPARQL-over-HTTP
- Ingest via Jena ARQ
- Ingest via Jena tdbloader
- Ingest via Vitro SPARQL-over-HTTP
- Ingest via TDB Java API
- Vitro Logging
- Detecting TDB Changes