adds support for configuring commands and channels using YAML #1034

elmjag · 2024-10-02T14:11:09Z

Adds support for configuring commands and channels using YAML. Currently it's possible to configure Tango, exporter and EPICS commands and channels.

This implements roughly the format discussed in: #1023
The actual format implement is documented here: https://mxcubecore--1034.org.readthedocs.build/en/1034/dev/commands_channels.html

This is still work in progress. Still on the todo list:

write some tests
do a bit more "manual" testing

I would like to get some feedback, before spending more time on this.

fabcor-maxiv

Good stuff.

A first review pass, a first batch of comments and improvement suggestions.

fabcor-maxiv · 2024-10-03T07:32:05Z

docs/source/dev/commands_channels.md

+| property  | purpose                           | default             |
+|-----------|-----------------------------------|---------------------|
+| attribute | tango attribute name              | MXCuBE channel name |
+| poll      | polling periodicity, milliseconds | polling is disabled |


changed to polling_period

fabcor-maxiv · 2024-10-03T07:42:52Z

docs/source/dev/commands_channels.md

+
+The mxcubecore provides a hardware object-level abstraction
+for communicating using various flavors of control system protocols.
+A hardware object can utilize instances of `Command` and `Channel` objects.


Link to the documentation for the actual classes, please.
(I always forget how to do it, look up the Myst doc: https://myst-parser.readthedocs.io/en/latest/syntax/cross-referencing.html).

Also isn't it mxcubecore.CommandContainer.ChannelObject and mxcubecore.CommandContainer.CommandObject?

Yes, it's mxcubecore.CommandContainer.ChannelObject and mxcubecore.CommandContainer.ChannelObject. Added links to API docs for these objects.

fabcor-maxiv · 2024-10-03T07:43:50Z

docs/source/dev/commands_channels.md

+for communicating using various flavors of control system protocols.
+A hardware object can utilize instances of `Command` and `Channel` objects.
+These objects provide a uniform API for accessing a specific control system.
+Mxcubecore provides support for using protocols such as _tango_, _EPICS_, _exporter_ and more.


Links, links, links! Documentation should have lots of links. Typically the first occurrence of every term should have a link to its definition.

Suggested change

Mxcubecore provides support for using protocols such as _tango_, _EPICS_, _exporter_ and more.

Mxcubecore provides support for using protocols such as [_tango_](https://pytango.readthedocs.io/), _EPICS_, _exporter_ and more.

https://docs.epics-controls.org/en/latest/ for the official EPICS docs (that is being reworked now as far as I know, but at least it's not the APS website from the 80's anymore 😄)

Added links to Tango and EPICS web sites.

fabcor-maxiv · 2024-10-03T07:45:12Z

docs/source/dev/commands_channels.md

+The general format for specifying `Command` and `Channel` objects is as follows:
+
+```yaml
+class: MegaCommunicator


To keep consistent with the rest of the example:

Suggested change

class: MegaCommunicator

class: <hardware-object-class>

fabcor-maxiv · 2024-10-03T07:46:06Z

docs/source/dev/commands_channels.md

+The format for specifying _tango_ `Command` and `Channel` objects is as follows:
+
+```yaml
+class: TangoCommunicator


Suggested change

class: TangoCommunicator

class: <hardware-object-class>

fabcor-maxiv · 2024-10-03T08:09:27Z

mxcubecore/model/protocols/epics.py

+    """
+    an EPICS channel configuration
+    """


Suggested change

"""

an EPICS channel configuration

"""

"""EPICS channel configuration."""

reluctantly changed!

fabcor-maxiv · 2024-10-03T08:10:13Z

mxcubecore/model/protocols/epics.py

+"""
+Models the `epics` section of YAML hardware configuration file.
+
+Provides an API to read configured EPICS channels.
+"""


Suggested change

"""

Models the `epics` section of YAML hardware configuration file.

Provides an API to read configured EPICS channels.

"""

"""Models for the `epics` section of YAML hardware configuration file.

Provides an API to read configured EPICS channels.

"""

stupid google!

fabcor-maxiv · 2024-10-03T08:10:59Z

mxcubecore/model/protocols/tango.py

+        """
+        get all tango devices specified in this section
+        """


Suggested change

"""

get all tango devices specified in this section

"""

"""Get all Tango devices specified in this section."""

fabcor-maxiv · 2024-10-03T08:12:46Z

mxcubecore/protocols_config.py

+    """
+    add the Command and Channel objects configured in the specified protocol section
+
+    parameters:


I think the sections are case-sensitive.

Suggested change

parameters:

Parameters:

works fine with lower case p:

mxcubecore/protocols_config.py

henrique-silva · 2024-10-04T12:55:46Z

docs/source/dev/commands_channels.md

+```yaml
+class: EpicsCommunicator
+epics:
+  "FOO:B:x1.":
+    channels:
+      State:
+        suffix: stat
+      Vol:
+```
+
+We have an `FOO:B:x1.` prefix specified, with two `Channel` objects `State` and `Vol`.
+`State` will use `FOO:B:x1.stat` PV name, specified by section's prefix and the `suffix` configuration property.
+`Vol` will use `FOO:B:x1.Vol` PV name, specified by section's prefix and channels MXCuBE name.


So, I think this might be a bit problematic, because the modeling of PV is usually $(PREFIX):$(DEVICE).$(PROPERTY), so one record - or PV - ( $(PREFIX):$(DEVICE)) will have multiple properties, for example an analog out has, .DESC (description), .VAL (value), .ASLO (slope).
But in this case that you're modelling it is way more likely that this will be separated into multiple PVs, so you'd likely have:

class: EpicsCommunicator epics: "FOO:B:": channels: State: suffix: pv_1.STAT Vol: suffix: volume.VAL

In the end I think the code will handle just fine if you're just appending, but the prefix is only the part before teh last colon (in most naming conventions of EPICS that I've seen)

I am not sure I am understanding you correctly, but would #1023 (comment) answer your question?

Yes, that's pretty much it.

It's just the non-obvious separation between PV/record and properties in EPICS that is a bit weird for modelling, but the simple concatenation should handle all cases

@elmjag I think it is worth modifying the epics example to show a more complex and complete example, that shows how to combine all those things.

Will this example make things more clear?

class: EpicsCommunicator epics: "FOO:B:": channels: State: suffix: pv_1.STAT Vol: suffix: volume.VAL Freq:

Regarding Freq channel, I want to include an example channel, without the optional config property suffix.

This way, it's possible to link to generated API documentation for CommandContainer and ChannelObject classes. Without this change, sphix refuses to create a link for CommandContainer and ChannelObject classes, from other section of the documentation.

Adds a section the describes how to configure hardware object's commands and channels using YAML configuration files. Documents the format for Tango, exporter and EPICS protocols.

Adds support for 'tango', 'exporter' and 'epics' sections to YAML configuration files. These section are used to configure Command and Channel objects for hardware objects.

elmjag added the YAML Work on supporting YAML configuration files. label Oct 2, 2024

elmjag mentioned this pull request Oct 2, 2024

channel and commands in YAML files #1023

Open

fabcor-maxiv reviewed Oct 3, 2024

View reviewed changes

henrique-silva reviewed Oct 4, 2024

View reviewed changes

elmjag force-pushed the yaml-commands-channels branch from a7bf566 to 617b67a Compare October 14, 2024 08:48

elmjag requested a review from marcus-oscarsson October 14, 2024 08:48

elmjag added 2 commits October 14, 2024 14:08

add docs on commands and channels YAML configuration format

4d39e12

Adds a section the describes how to configure hardware object's commands and channels using YAML configuration files. Documents the format for Tango, exporter and EPICS protocols.

adds support for configuring commands and channels using YAML

138f62e

Adds support for 'tango', 'exporter' and 'epics' sections to YAML configuration files. These section are used to configure Command and Channel objects for hardware objects.

elmjag force-pushed the yaml-commands-channels branch from 617b67a to 138f62e Compare October 14, 2024 12:08

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

adds support for configuring commands and channels using YAML #1034

adds support for configuring commands and channels using YAML #1034

elmjag commented Oct 2, 2024 •

edited

Loading

fabcor-maxiv left a comment

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

henrique-silva Oct 4, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

fabcor-maxiv Oct 3, 2024

elmjag Oct 14, 2024

henrique-silva Oct 4, 2024 •

edited

Loading

fabcor-maxiv Oct 4, 2024

henrique-silva Oct 4, 2024

fabcor-maxiv Oct 4, 2024

elmjag Oct 14, 2024

	\| poll \| polling periodicity, milliseconds \| polling is disabled \|
	\| polling_period \| polling periodicity, milliseconds \| polling is disabled \|

	Mxcubecore provides support for using protocols such as _tango_, _EPICS_, _exporter_ and more.
	Mxcubecore provides support for using protocols such as [_tango_](https://pytango.readthedocs.io/), _EPICS_, _exporter_ and more.

adds support for configuring commands and channels using YAML #1034

Are you sure you want to change the base?

adds support for configuring commands and channels using YAML #1034

Conversation

elmjag commented Oct 2, 2024 • edited Loading

fabcor-maxiv left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

henrique-silva Oct 4, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

elmjag commented Oct 2, 2024 •

edited

Loading

henrique-silva Oct 4, 2024 •

edited

Loading