Welcome to Web Monitor’s documentation!
Data Workflow Manager
SNS data workflow manager and reporting app
It consists of 3 applications (Workflow Manager, Web Monitor, and DASMON Listener) which are deployed via docker-compose.
Workflow Manager
Data workflow manager based on ActiveMQ
The database abstraction is done through django.db and the communication layer is done using stomp.
The icat_activemq.xml
file is the ActiveMQ configuration used to set up the cluster of brokers.
Use sns_post_processing.py
to start the workflow manager.
Use test/test_consumer.py
to simulate the worker nodes.
Web Monitor
Reporting application for the workflow manager.
The reporting app is built using django.
It connects to the reporting database used by the workflow manager.
Look at the docker-compose.yml
to see how to configure and run it.
DASMON listener
DB logging daemon.
The DASMON listener watches for DASMON message sent to ActiveMQ and logs them.
See the src/dasmon_app/dasmon_listener/README.md
file for more details.
PostgreSQL optimization:
If using PostgreSQL, you can install the stored procedure in reporting/report/sql/stored_procs.sql
.
Those will speed up the run rate and error rate queries.
No change needs to be made to the settings when installing those stored procedures and the application will use them automatically.
Developer’s Entry Point
Start at the Developer’s documentation. This requires building the docs:
$ make create/conda
$ make docs