Skip to content

Commit

Permalink
docs conformance
Browse files Browse the repository at this point in the history
  • Loading branch information
fabricebrito committed Nov 23, 2023
1 parent 418f014 commit b0b7f36
Show file tree
Hide file tree
Showing 26 changed files with 952 additions and 135 deletions.
173 changes: 88 additions & 85 deletions conformance/README.md

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion conformance/run-job-1-0.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,4 +7,4 @@ NAMESPACE_NAME="calrissian-conformance"
kubectl create --namespace="$NAMESPACE_NAME" -f ConformanceTestsJob-1.0.yaml
kubectl wait --namespace="$NAMESPACE_NAME" --for=condition=Ready --selector=job-name=conformance-tests-1-0 pods
kubectl logs --namespace="$NAMESPACE_NAME" -f jobs/conformance-tests-1-0 | egrep -v 'The `label`' > results-v1.1.txt
kubectl cp $NAMESPACE_NAME/inspect-volumes:/output/badges-1.0/ badges/1.0
kubectl cp $NAMESPACE_NAME/inspect-volumes:/output/badges-1.0.2/ badges/1.0.2
30 changes: 30 additions & 0 deletions docs/conformance/1.0.2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
## Conformance tests for CWL v1.0 for the latest release

### Classes

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/workflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/command_line_tool.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/expression_tool.json?icon=commonwl)

### Required features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/required.json?icon=commonwl)

### Optional features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/docker.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/env_var.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/initial_work_dir.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/inline_javascript.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/multiple_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/resource.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/scatter.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/schema_def.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/shell_command.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/step_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/step_input_expression.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.0.2/subworkflow.json?icon=commonwl)

### Conformance output

[result-v1.0.txt](../result-v1.0.txt){:download}
30 changes: 0 additions & 30 deletions docs/conformance/1.0.md

This file was deleted.

32 changes: 32 additions & 0 deletions docs/conformance/1.1.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
## Conformance tests for CWL v1.1 for the latest release

### Classes

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/workflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/command_line_tool.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/expression_tool.json?icon=commonwl)

### Required features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/required.json?icon=commonwl)

### Optional features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/docker.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/env_var.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/format_checking.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/initial_work_dir.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/inline_javascript.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/inplace_update.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/input_object_requirements.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/multiple_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/networkaccess.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/resource.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/scatter.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/schema_def.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/shell_command.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/step_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/step_input_expression.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/subworkflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.1.0/timelimit.json?icon=commonwl)

35 changes: 35 additions & 0 deletions docs/conformance/1.2.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
## Conformance tests for CWL v1.2.0 for the latest release

### Classes

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/workflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/command_line_tool.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/expression_tool.json?icon=commonwl)

### Required features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/required.json?icon=commonwl)

### Optional features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/conditional.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/docker.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/env_var.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/format_checking.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/initial_work_dir.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/inline_javascript.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/inplace_update.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/input_object_requirements.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/multiple.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/multiple_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/networkaccess.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/resource.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/scatter.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/schema_def.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/secondary_files.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/shell_command.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/step_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/step_input_expression.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/subworkflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/1.2.0/timelimit.json?icon=commonwl)

38 changes: 38 additions & 0 deletions docs/conformance/1.2.1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
## Conformance tests for CWL v1.2.1 (proposed) for the latest release

### Classes

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/workflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/command_line_tool.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/expression_tool.json?icon=commonwl)

### Required features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/required.json?icon=commonwl)

### Optional features

![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/conditional.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/docker.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/env_var.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/format_checking.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/initial_work_dir.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/inline_javascript.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/inplace_update.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/input_object_requirements.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/json_schema_invalid.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/load_listing.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/multiple.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/multiple_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/multiple.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/networkaccess.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/resource.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/scatter.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/schema_def.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/secondary_files.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/shell_command.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/step_input.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/subworkflow.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/timelimit.json?icon=commonwl)
![test result](https://flat.badgen.net/https/raw.githubusercontent.com/Duke-GCB/calrissian/master/conformance/badges/badges-1.2.1_proposed/work_reuse.json?icon=commonwl)

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/command_line_tool.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/docker.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/env_var.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/expression_tool.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/initial_work_dir.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/inline_javascript.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/multiple_input.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/required.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/resource.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/scatter.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/schema_def.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/shell_command.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/step_input.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/step_input_expression.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/subworkflow.json

This file was deleted.

1 change: 0 additions & 1 deletion docs/conformance/badges/1.0.2/workflow.json

This file was deleted.

File renamed without changes.
Loading

0 comments on commit b0b7f36

Please sign in to comment.