-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
make the README runnable in Livebook :) #415
Open
spencerolson
wants to merge
3
commits into
wojtekmach:main
Choose a base branch
from
spencerolson:livebook
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,236 @@ | ||
# Req | ||
|
||
## Section | ||
|
||
[![CI](https://github.com/wojtekmach/req/actions/workflows/ci.yml/badge.svg)](https://github.com/wojtekmach/req/actions/workflows/ci.yml) | ||
[![License](https://img.shields.io/hexpm/l/req.svg)](https://github.com/wojtekmach/req/blob/main/LICENSE.md) | ||
[![Version](https://img.shields.io/hexpm/v/req.svg)](https://hex.pm/packages/req) | ||
[![Hex Docs](https://img.shields.io/badge/documentation-gray.svg)](https://hexdocs.pm/req) | ||
|
||
[![Run in Livebook](https://livebook.dev/badge/v1/blue.svg)](https://livebook.dev/run?url=https%3A%2F%2Fgithub.com%2Fwojtekmach%2Freq%2Fblob%2Fmain%2FREADME.livemd) | ||
|
||
Req is a batteries-included HTTP client for Elixir. | ||
|
||
With just a couple lines of code: | ||
|
||
```elixir | ||
Mix.install([ | ||
{:req, "~> 0.5.0"} | ||
]) | ||
|
||
Req.get!("https://api.github.com/repos/wojtekmach/req").body["description"] | ||
# => "Req is a batteries-included HTTP client for Elixir." | ||
``` | ||
|
||
we get automatic response body decompression & decoding, following redirects, retrying on errors, | ||
and much more. Virtually all of the features are broken down into individual functions called | ||
_steps_. You can easily re-use and re-arrange built-in steps (see [`Req.Steps`] module) and | ||
write new ones. | ||
|
||
## Features | ||
|
||
* An easy to use high-level API: [`Req.request/1`], [`Req.new/1`], [`Req.get!/2`], [`Req.post!/2`], etc. | ||
|
||
* Extensibility via request, response, and error steps. | ||
|
||
* Request body compression (via [`compress_body`] step) | ||
|
||
* Automatic response body decompression (via [`compressed`] and [`decompress_body`] steps). Supports gzip, brotli, and zstd. | ||
|
||
* Request body encoding. Supports urlencoded and multipart forms, and JSON. See [`encode_body`]. | ||
|
||
* Automatic response body decoding (via [`decode_body`] step.) | ||
|
||
* Encode params as query string (via [`put_params`] step.) | ||
|
||
* Setting base URL (via [`put_base_url`] step.) | ||
|
||
* Templated request paths (via [`put_path_params`] step.) | ||
|
||
* Basic, bearer, and `.netrc` authentication (via [`auth`] step.) | ||
|
||
* Range requests (via [`put_range`]) step.) | ||
|
||
* Use AWS V4 Signature (via [`put_aws_sigv4`]) step.) | ||
|
||
* Request body streaming (by setting `body: enumerable`.) | ||
|
||
* Response body streaming (by setting `into: fun | collectable | :self`.) | ||
|
||
* Follows redirects (via [`redirect`] step.) | ||
|
||
* Retries on errors (via [`retry`] step.) | ||
|
||
* Raise on 4xx/5xx errors (via [`handle_http_errors`] step.) | ||
|
||
* Verify response body against a checksum (via [`checksum`] step.) | ||
|
||
* Basic HTTP caching (via [`cache`] step.) | ||
|
||
* Easily create test stubs (see [`Req.Test`].) | ||
|
||
* Running against a plug (via [`run_plug`] step.) | ||
|
||
* Pluggable adapters. By default, Req uses [Finch] (via [`run_finch`] step.) | ||
|
||
## Usage | ||
|
||
The easiest way to use Req is with [`Mix.install/2`] (requires Elixir v1.12+): | ||
|
||
```elixir | ||
Mix.install([ | ||
{:req, "~> 0.5.0"} | ||
]) | ||
|
||
Req.get!("https://api.github.com/repos/wojtekmach/req").body["description"] | ||
# => "Req is a batteries-included HTTP client for Elixir." | ||
``` | ||
|
||
If you want to use Req in a Mix project, you can add the above dependency to your `mix.exs`. | ||
|
||
Here's an example POST with JSON data: | ||
|
||
```elixir | ||
Req.post!("https://httpbin.org/post", json: %{x: 1, y: 2}).body["json"] | ||
# => %{"x" => 1, "y" => 2} | ||
``` | ||
|
||
You can stream request body: | ||
|
||
```elixir | ||
stream = Stream.duplicate("foo", 3) | ||
Req.post!("https://httpbin.org/post", body: stream).body["data"] | ||
# => "foofoofoo" | ||
``` | ||
|
||
and stream the response body: | ||
|
||
```elixir | ||
resp = Req.get!("http://httpbin.org/stream/2", into: IO.stream()) | ||
# output: {"url": "http://httpbin.org/stream/2", ...} | ||
# output: {"url": "http://httpbin.org/stream/2", ...} | ||
%{status: resp.status, body: resp.body} | ||
# => %{status: 200, body: %IO.Stream{device: :standard_io, raw: false, line_or_bytes: :line}} | ||
``` | ||
|
||
(See [`Req`] module documentation for more examples of response body streaming.) | ||
|
||
If you are planning to make several similar requests, you can build up a request struct with | ||
desired common options and re-use it: | ||
|
||
```elixir | ||
req = Req.new(base_url: "https://api.github.com") | ||
|
||
finch = Req.get!(req, url: "/repos/sneako/finch").body["description"] | ||
# => "Elixir HTTP client, focused on performance" | ||
|
||
mint = Req.get!(req, url: "/repos/elixir-mint/mint").body["description"] | ||
# => "Functional HTTP client for Elixir with support for HTTP/1 and HTTP/2." | ||
|
||
%{finch: finch, mint: mint} | ||
``` | ||
|
||
See [`Req.new/1`] for more information on available options. | ||
|
||
Virtually all of Req's features are broken down into individual pieces - steps. Req works by running | ||
the request struct through these steps. You can easily reuse or rearrange built-in steps or write new | ||
ones. Importantly, steps are just regular functions. Here is another example where we append a request | ||
step that inspects the URL just before requesting it: | ||
|
||
```elixir | ||
req = | ||
Req.new(base_url: "https://api.github.com") | ||
|> Req.Request.append_request_steps( | ||
debug_url: fn request -> | ||
IO.inspect(URI.to_string(request.url)) | ||
request | ||
end | ||
) | ||
|
||
Req.get!(req, url: "/repos/wojtekmach/req").body["description"] | ||
# output: "https://api.github.com/repos/wojtekmach/req" | ||
# => "Req is a batteries-included HTTP client for Elixir." | ||
``` | ||
|
||
Custom steps can be packaged into plugins so that they are even easier to use by others. | ||
Here are some examples: | ||
|
||
* [`req_easyhtml`] | ||
* [`req_s3`] | ||
* [`req_hex`] | ||
* [`req_github_oauth`] | ||
|
||
And here is how they can be used: | ||
|
||
```elixir | ||
Mix.install([ | ||
{:req, "~> 0.5.0"}, | ||
{:req_easyhtml, "~> 0.1.0"}, | ||
{:req_s3, "~> 0.2.3"}, | ||
{:req_hex, "~> 0.2.0"}, | ||
{:req_github_oauth, "~> 0.1.0"} | ||
]) | ||
|
||
req = | ||
Req.new(http_errors: :raise) | ||
|> ReqEasyHTML.attach() | ||
|> ReqS3.attach() | ||
|> ReqHex.attach() | ||
|> ReqGitHubOAuth.attach() | ||
|
||
Req.get!(req, url: "https://elixir-lang.org").body[".entry-summary h5"] | ||
# => | ||
# #EasyHTML[<h5> | ||
# Elixir is a dynamic, functional language for building scalable and maintainable applications. | ||
# </h5>] | ||
|
||
Req.get!(req, url: "s3://ossci-datasets/mnist/t10k-images-idx3-ubyte.gz").body | ||
# => <<0, 0, 8, 3, ...>> | ||
|
||
Req.get!(req, url: "https://repo.hex.pm/tarballs/req-0.1.0.tar").body["metadata.config"]["links"] | ||
# => %{"GitHub" => "https://github.com/wojtekmach/req"} | ||
|
||
Req.get!(req, url: "https://api.github.com/user").body["login"] | ||
# output: | ||
# paste this user code: | ||
# | ||
# 6C44-30A8 | ||
# | ||
# at: | ||
# | ||
# https://github.com/login/device | ||
# | ||
# open browser window? [Yn] | ||
# 15:22:28.350 [info] response: authorization_pending | ||
# 15:22:33.519 [info] response: authorization_pending | ||
# 15:22:38.678 [info] response: authorization_pending | ||
# => "wojtekmach" | ||
|
||
Req.get!(req, url: "https://api.github.com/user").body["login"] | ||
# => "wojtekmach" | ||
``` | ||
|
||
See [`Req.Request`] module documentation for more information on low-level API, request struct, and developing plugins. | ||
|
||
## Presentations | ||
|
||
* [Req: A batteries-included HTTP client for Elixir - ElixirConf 2023, 2023-09-08](https://www.youtube.com/watch?v=owz2QacFuoQ "ElixirConf 2023 - Wojtek Mach - Req - a batteries-included HTTP client for Elixir") | ||
* [Req: A batteries included HTTP client for Elixir - Elixir Kenya, 2022-08-26](https://www.youtube.com/watch?v=NxWgvHRN6mI "Req: A batteries included HTTP client for Elixir") | ||
|
||
## Acknowledgments | ||
|
||
Req is built on top of [Finch] and is inspired by [cURL], [Requests], [Tesla], and many other HTTP clients - thank you! | ||
|
||
## License | ||
|
||
Copyright (c) 2021 Wojtek Mach | ||
|
||
Licensed under the Apache License, Version 2.0 (the "License"); | ||
you may not use this file except in compliance with the License. | ||
You may obtain a copy of the License at [http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0) | ||
|
||
Unless required by applicable law or agreed to in writing, software | ||
distributed under the License is distributed on an "AS IS" BASIS, | ||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
See the License for the specific language governing permissions and | ||
limitations under the License. |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Adds a "Run in Livebook" button.
The rest of the changes are minor changes to the code samples to make them work in Livebook.