scimex

SeisComP3 event exchange between two systems.

Description

scimex manages the SC3 object exchange between different SeisComP3 systems in realtime. scimex may import or export the data to one or several systems. In contrary to scimport the exchange of the SC3 objects is event based.

By default all objects (picks, amplitudes, origins, arrivals, station magnitudes, magnitudes, magnitude references) are transferred to the other system. The user can define filters to exclude objects from being transferred. Possible filter parameter are location, magnitude, arrival count and agency. scimex supports two modi: import and export. In export mode scimex collects all objects relevant for an event (e.g. picks, amplitudes, origins, magnitudes) from scmasters message groups at the source and checks if the filter criteria match. Once the criteria are fulfilled, the whole package of objects is send to the scmaster IMPORT group of the receiving system.

At the receiving system an instance of scimex is running in import mode. It fetches the whole event information from the IMPORT group, checks the local filter criteria of the system and sends the collected objects to the different messages groups, e.g. Pick, Amplitude, Magnitude, Location. In export mode several recipients can be defined and for each recipient individual filters can be set. To run several instances of scimex on one system, aliases have to be defined, e.g. for import:

seiscomp alias create scimex_import scimex

and for export:

seiscomp alias create scimex_export scimex

Then the configuration can be split into scimex_import.cfg and scimex_export.cfg.

Examples

scimex_import.cfg

connection.username = scimexIm
connection.server = localhost

mode = IMPORT

cleanUpInterval=86400

importSink = import1

criteria.world.longitude = -180:180
criteria.world.latitude = -90:90
criteria.world.magnitude = 1:9
criteria.world.agencyID = ""
criteria.world.arrivalcount = 15

hosts.import1.address = localhost
# The criterion "world" has been defined above
hosts.import1.criteria= world
# optional and true per default
hosts.import1.filter = false
# optional and true per default
hosts.import1.useDefinedRoutingTable = true
hosts.import1.routingtable = Pick:IMPORT,StationAmplitude:IMPORT,
                               Origin:LOCATION,Arrival:LOCATION,
                               StationMagnitude:MAGNITUDE,
                               Magnitude:MAGNITUDE,
                               StationMagnitudeContribution:MAGNITUDE,
                               OriginReference:EVENT,Event:EVENT

scimex_export.cfg

connection.username="scimexEx"
connection.server = localhost

mode = EXPORT

cleanUpInterval = 7200
exportSink = exp1, exp2

# Match everything with magnitude above or equal 5
# and with more than 25 phases which comes from
# agency GFZ.
criteria.globalM5.latitude     = -90:90
criteria.globalM5.longitude    = -180:180
criteria.globalM5.magnitude    = 5:10
criteria.globalM5.arrivalcount = 25
criteria.globalM5.agencyid     = GFZ

# Export to a system which still runs a very old version. The
# messages need to be converted.
hosts.exp1.address = 192.168.0.3
hosts.exp1.criteria = globalM5
hosts.exp1.conversion = imexscdm0.51

hosts.exp2.address = 192.168.0.4
hosts.exp2.criteria = globalM5

Configuration

etc/defaults/global.cfg

etc/defaults/scimex.cfg

etc/global.cfg

etc/scimex.cfg

~/.seiscomp3/global.cfg

~/.seiscomp3/scimex.cfg

scimex inherits global options.

mode

Type: string

Type of mode, options are IMPORT or EXPORT.

cleanupinterval

Type: double

Cache lifetime for objects.

subscriptions

Type: list:string

Only used in export mode. A list of message groups to subscribe.

conversion

Type: string

Used only in import mode. It defines the source format of the messages that need to be converted. Currently the import of SeisComP3 datamodel version 0.51 (imexscdm0.51) is supported which was used in release Barcelona (2008).

importHosts

Type: string

List of importing systems (AgencyIDs) defined like recipients.

exportHosts

Type: string

List of recipients names (AgencyIDs) defined in the following, e.g. EMSC, IGN.

Note

criteria.$name.* A definition of an event filter. $name is a placeholder for the name to be used.

criteria.$name.latitude

Type: tuple:double

Tuple of doubles that defines the latitude range, e.g. -90:90.

criteria.$name.longitude

Type: tuple:double

Tuple of doubles that defines the longitude range, e.g. -180:180.

criteria.$name.magnitude

Type: tuple:double

Tuple of doubles that defines the magnitude range, e.g. 3:10.

criteria.$name.arrivalcount

Type: int

Number of minimum arrivals.

criteria.$name.agencyid

Type: list:string

White lits of agency ids.

Note

hosts.$name.* A sink definition used for either import or export. $name is a placeholder for the name to be used.

hosts.$name.address

Type: string

Address of sink, e.g. address = 192.168.1.1.

hosts.$name.criteria

Type: string

Defining filter criteria name for sink, e.g. criteria = world-xxl. The criteria must be defined in the criteria.*.

hosts.$name.filter

Type: boolean

Enables/disables filtering based on defined criteria. If set to false and even a criteria is defined, all events will pass. Default is true.

hosts.$name.conversion

Type: string

Optional target format for export.

hosts.$name.useDefinedRoutingTable

Type: boolean

Enables/disables defined routing tables. Default is false.

hosts.$name.routingTable

Type: list:string

Defining routing tables in the meaning of mapping objects to message groups. E.g. Pick:NULL, StationAmplitude:NULL, Origin:LOCATION, StationMagnitude: MAGNITUDE, NetworkMagnitude:MAGNITUDE, MagnitudeReference:MAGNITUDE, OriginReference:EVENT, Event:EVENT.

Command-line

Generic

-h, --help

show help message.

-V, --version

show version information

--config-file arg

Use alternative configuration file. When this option is used the loading of all stages is disabled. Only the given configuration file is parsed and used. To use another name for the configuration create a symbolic link of the application or copy it, eg scautopick -> scautopick2.

--plugins arg

Load given plugins.

-D, --daemon

Run as daemon. This means the application will fork itself and doesn't need to be started with &.

--auto-shutdown arg

Enable/disable self-shutdown because a master module shutdown. This only works when messaging is enabled and the master module sends a shutdown message (enabled with --start-stop-msg for the master module).

--shutdown-master-module arg

Sets the name of the master-module used for auto-shutdown. This is the application name of the module actually started. If symlinks are used then it is the name of the symlinked application.

--shutdown-master-username arg

Sets the name of the master-username of the messaging used for auto-shutdown. If "shutdown-master-module" is given as well this parameter is ignored.

Verbosity

--verbosity arg

Verbosity level [0..4]. 0:quiet, 1:error, 2:warning, 3:info, 4:debug

-v, --v

Increase verbosity level (may be repeated, eg. -vv)

-q, --quiet

Quiet mode: no logging output

--component arg

Limits the logging to a certain component. This option can be given more than once.

-s, --syslog

Use syslog logging back end. The output usually goes to /var/lib/messages.

-l, --lockfile arg

Path to lock file.

--console arg

Send log output to stdout.

--debug

Debug mode: --verbosity=4 --console

--log-file arg

Use alternative log file.

Messaging

-u, --user arg

Overrides configuration parameter connection.username.

-H, --host arg

Overrides configuration parameter connection.server.

-t, --timeout arg

Overrides configuration parameter connection.timeout.

-g, --primary-group arg

Overrides configuration parameter connection.primaryGroup.

-S, --subscribe-group arg

A group to subscribe to. This option can be given more than once.

--encoding arg

Overrides configuration parameter connection.encoding.

--start-stop-msg arg

Sets sending of a start- and a stop message.

IMEX

--print-default-routingtable

Print the default object routingtable.