Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pipeline: links and examples update for 1.x #1584

Merged
merged 19 commits into from
Jul 29, 2020
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions content/docs/command-reference/commit.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,10 +20,10 @@ positional arguments:

The `dvc commit` command is useful for several scenarios, when data already
tracked by DVC changes: when a [stage](/doc/command-reference/run) or
[pipeline](/doc/command-reference/pipeline) is in development/experimentation;
when manually editing or generating DVC <abbr>outputs</abbr>; or to force
DVC-file updates without reproducing stages or pipelines. These scenarios are
further detailed below.
[pipeline](/doc/command-reference/dag) is in development/experimentation; when
manually editing or generating DVC <abbr>outputs</abbr>; or to force DVC-file
updates without reproducing stages or pipelines. These scenarios are further
detailed below.

- Code or data for a stage is under active development, with multiple iterations
(experiments) in code, configuration, or data. Use the `--no-commit` option of
Expand Down
5 changes: 1 addition & 4 deletions content/docs/command-reference/fetch.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ on DVC remotes.) These necessary data or model files are listed as
<abbr>dependencies</abbr> or <abbr>outputs</abbr> in a target
[stage](/doc/command-reference/run) (in `dvc.yaml`) or `.dvc` file, so they are
required to [reproduce](/doc/tutorials/get-started/data-pipelines#reproduce) the
corresponding [pipeline](/doc/command-reference/pipeline).
corresponding [pipeline](/doc/command-reference/dag).

`dvc fetch` ensures that the files needed for a stage or `.dvc` file to be
[reproduced](/doc/tutorials/get-started/data-pipelines#reproduce) exist in
Expand Down Expand Up @@ -136,9 +136,6 @@ $ cd example-get-started

</details>

The workspace looks almost like in this
[pipeline setup](/doc/tutorials/pipelines):

```dvc
.
├── data
Expand Down
2 changes: 1 addition & 1 deletion content/docs/command-reference/freeze.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ reproduction will not regenerate <abbr>outputs</abbr> of frozen stages, even if
their <abbr>dependencies</abbr> have changed, and even if `--force` is used.

Freezing a stage is useful to avoid syncing data from the top of its
[pipeline](/doc/command-reference/pipeline), and keep iterating on the last
[pipeline](/doc/command-reference/dag), and keep iterating on the last
(non-frozen) stages only.

Note that <abbr>import stages</abbr> are frozen by default. Use `dvc update` to
Expand Down
4 changes: 2 additions & 2 deletions content/docs/command-reference/import-url.md
Original file line number Diff line number Diff line change
Expand Up @@ -194,8 +194,8 @@ trying this example (especially if trying out the following one).

What if that remote file is updated regularly? The project goals might include
regenerating some results based on the updated data source.
[Pipeline](/doc/command-reference/pipeline) reproduction can be triggered based
on a changed external dependency.
[Pipeline](/doc/command-reference/dag) reproduction can be triggered based on a
changed external dependency.

Let's use the [Get Started](/doc/tutorials/get-started) project again,
simulating an updated external data source. (Remember to prepare the
Expand Down
2 changes: 1 addition & 1 deletion content/docs/command-reference/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ DVC is a command line tool. The typical DVC workflow goes as follows:
`dvc run` command, along with its `--outs` option for <abbr>outputs</abbr>
that should also be tracked by DVC after the code is executed.
- Sharing a Git repository with the source code of your ML
[pipeline](/doc/command-reference/pipeline) will not include the project's
[pipeline](/doc/command-reference/dag) will not include the project's
<abbr>cache</abbr>. Use [remote storage](/doc/command-reference/remote) and
`dvc push` to share this cache (data tracked by DVC).
- Use `dvc repro` to automatically reproduce your full pipeline, iteratively as
Expand Down
2 changes: 1 addition & 1 deletion content/docs/command-reference/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ This hook automates `dvc checkout` after `git checkout`.
**Commit/Reproduce**: Before committing DVC changes with Git, it may be
necessary using `dvc commit` to store new data files not yet in cache. Or the
changes might require reproducing the corresponding
[pipeline](/doc/command-reference/pipeline) (with `dvc repro`) to regenerate the
[pipeline](/doc/command-reference/dag) (with `dvc repro`) to regenerate the
project's results (which implicitly commits them to DVC as well).

This hook automates `dvc status` before `git commit` when needed, to remind the
Expand Down
9 changes: 3 additions & 6 deletions content/docs/command-reference/pull.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,8 @@ used to see what files `dvc pull` would download.
If one or more `targets` are specified, DVC only considers the files associated
with those stages or `.dvc` files. Using the `--with-deps` option, DVC tracks
dependencies backward from the target [stage files](/doc/command-reference/run),
through the corresponding [pipelines](/doc/command-reference/pipeline), to find
data files to pull.
through the corresponding [pipelines](/doc/command-reference/dag), to find data
files to pull.

After a data file is in cache, `dvc pull` can use OS-specific mechanisms like
reflinks or hardlinks to put it in the workspace without copying. See
Expand Down Expand Up @@ -129,9 +129,6 @@ $ cd example-get-started

</details>

The workspace looks almost like in this
[pipeline setup](/doc/tutorials/pipelines):

```dvc
.
├── data
Expand Down Expand Up @@ -167,7 +164,7 @@ $ dvc pull train.dvc
> Please delete the `.dvc/cache` directory first (with `rm -Rf .dvc/cache`) to
> follow this example if you tried the previous ones.

Our [pipeline](/doc/command-reference/pipeline) has been setup with these
Our [pipeline](/doc/command-reference/dag) has been setup with these
[stages](/doc/command-reference/run):

```dvc
Expand Down
4 changes: 2 additions & 2 deletions content/docs/command-reference/push.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ cache (compared to the default remote.) It can be used to see what files
If one or more `targets` are specified, DVC only considers the files associated
with them. Using the `--with-deps` option, DVC tracks dependencies backward from
the target [stage files](/doc/command-reference/run), through the corresponding
[pipelines](/doc/command-reference/pipeline), to find data files to push.
[pipelines](/doc/command-reference/dag), to find data files to push.

## Options

Expand Down Expand Up @@ -151,7 +151,7 @@ $ dvc push data.zip.dvc
## Example: With dependencies

Demonstrating the `--with-deps` option requires a larger example. First, assume
a [pipeline](/doc/command-reference/pipeline) has been setup with these
a [pipeline](/doc/command-reference/dag) has been setup with these
[stages](/doc/command-reference/run):

```dvc
Expand Down
4 changes: 2 additions & 2 deletions content/docs/command-reference/repro.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# repro

Reproduce complete or partial [pipelines](/doc/command-reference/pipeline) by
Reproduce complete or partial [pipelines](/doc/command-reference/dag) by
executing commands defined in their [stages](/doc/command-reference/run) in the
correct order. The commands to be executed are determined by recursively
analyzing dependencies and <abbr>outputs</abbr> of the target stages.
Expand Down Expand Up @@ -166,7 +166,7 @@ only execute the final stage.

For simplicity, let's build a pipeline defined below. (If you want get your
hands-on something more real, see this short
[pipeline tutorial](/doc/tutorials/pipelines)). It takes this `text.txt` file:
[pipeline tutorial](/doc/start/data-pipelines)). It takes this `text.txt` file:

```
dvc
Expand Down
12 changes: 6 additions & 6 deletions content/docs/command-reference/run.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,8 @@ positional arguments:
## Description

`dvc run` is a helper for creating or updating
[pipeline](/doc/command-reference/pipeline) stages in a `dvc.yaml` file (located
in the current working directory). _Stages_ represent individual data processes,
[pipeline](/doc/command-reference/dag) stages in a `dvc.yaml` file (located in
the current working directory). _Stages_ represent individual data processes,
including their input and resulting outputs.

A stage name is required and can be provided using the `-n` (`--name`) option.
Expand Down Expand Up @@ -112,8 +112,8 @@ run directly, for example a shell built-in, expression, or binary found in
by the command itself, not by `dvc run`.

⚠️ Note that while DVC is platform-agnostic, the commands defined in your
[pipeline](/doc/command-reference/pipeline) stages may only work on some
operating systems and require certain software packages to be installed.
[pipeline](/doc/command-reference/dag) stages may only work on some operating
systems and require certain software packages to be installed.

Wrap the command with double quotes `"` if there are special characters in it
like `|` (pipe) or `<`, `>` (redirection), otherwise they would apply to
Expand Down Expand Up @@ -330,8 +330,8 @@ $ tree ..

## Example: Chaining stages

DVC [pipelines](/doc/command-reference/pipeline) are constructed by connecting
the outputs of a stage to the dependencies of the following one(s).
DVC [pipelines](/doc/command-reference/dag) are constructed by connecting the
outputs of a stage to the dependencies of the following one(s).

Extract an XML file from an archive to the `data/` folder:

Expand Down
2 changes: 1 addition & 1 deletion content/docs/command-reference/status.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# status

Show changes in the <abbr>project</abbr>
[pipelines](/doc/command-reference/pipeline), as well as file mismatches either
[pipelines](/doc/command-reference/dag), as well as file mismatches either
between the <abbr>cache</abbr> and <abbr>workspace</abbr>, or between the cache
and remote storage.

Expand Down