Skip to content

Commit

Permalink
Merge pull request #4 from OpenLineage/20240227/update
Browse files Browse the repository at this point in the history
Feb 24 update.
  • Loading branch information
merobi-hub authored Feb 27, 2024
2 parents b71abfc + 1c6fa3c commit 6df6d06
Show file tree
Hide file tree
Showing 21 changed files with 103,792 additions and 1,125 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# OpenLineage Slack Archive

To get an export (entire history): workspace>Tools & Settings>Workspace settings

To get the HTML with slack-export-viewer (from root): `python3 app.py -z /abs/path/to/export/dir --html-only`

Browse the archive at https://openlineage.github.io/slack-archives/.

## Acknowledgements
Expand Down
112 changes: 111 additions & 1 deletion channel/boston-meetup/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,18 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../github-discussions/index.html">
# github-discussions
</a>
</li>

<li class="channel">
<a href="../github-notifications/index.html">
# github-notifications
</a>
</li>

<li class="channel">
<a href="../gx-integration/index.html">
# gx-integration
Expand Down Expand Up @@ -94,6 +106,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../spark-support-multiple-scala-versions/index.html">
# spark-support-multiple-scala-versions
</a>
</li>

<li class="channel">
<a href="../spec-compliance/index.html">
# spec-compliance
Expand All @@ -106,6 +124,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../user-generated-metadata/index.html">
# user-generated-metadata
</a>
</li>

</ul>
<h3 id="group-title">Private Channels</h3>
<ul class="list" id="group-list">
Expand Down Expand Up @@ -184,7 +208,7 @@ <h3 id="mpim-title">Group Direct Messages</h3>
<div class="message-container channel_join ">
<div id="2023-04-28 12:49:45">

<img src="https://avatars.slack-edge.com/2020-12-18/1581303887318_7467955ae073e3a3757f_72.jpg" class="user_icon" />
<img src="https://avatars.slack-edge.com/2024-02-13/6632810980691_4bdd0e9610cf6b203517_72.jpg" class="user_icon" />


<div class="message">
Expand Down Expand Up @@ -419,6 +443,92 @@ <h3 id="mpim-title">Group Direct Messages</h3>





<div class="message-container">
<div id="2024-02-12 10:46:23">

<img src="https://avatars.slack-edge.com/2022-01-25/3019716733729_66fea720e9504dc08144_72.jpg" class="user_icon" />


<div class="message">

<div class="username">Michael Robinson
<span class="print-only user-email">([email protected])</span>
</div>
<a href="#2024-02-12 10:46:23"><div class="time">2024-02-12 10:46:23</div></a>
<div class="msg">
<p>Hi everyone, it looks like we're finally going to hold our first Boston meetup! Please reserve the evening of <strong>March 19th.</strong> Thanks @Sheeri Cabral (Collibra) for finding space: we'll be meeting at Microsoft New England. Keep an eye out for a meetup page, etc., and let me or Sheeri know if you'd like to speak.</p>



<div class="message-reaction">
🎉 Harel Shein, Sheeri Cabral (Collibra)
</div>

</div>
</div>
</div>
</div>





<div class="message-container">
<div id="2024-02-13 12:54:09">

<img src="https://secure.gravatar.com/avatar/0f9e11ecf9b45c68ee6f9d72f2b931d8.jpg?s=72&amp;d=https%3A%2F%2Fa.slack-edge.com%2Fdf10d%2Fimg%2Favatars%2Fava_0006-72.png" class="user_icon" />


<div class="message">

<div class="username">Sheeri Cabral (Collibra)
<span class="print-only user-email">([email protected])</span>
</div>
<a href="#2024-02-13 12:54:09"><div class="time">2024-02-13 12:54:09</div></a>
<div class="msg">
<p>Here’s the meetup link to RSVP:
<a href="https://www.meetup.com/boston-data-lineage-meetup-group/events/298893366/">https://www.meetup.com/boston-data-lineage-meetup-group/events/298893366/</a></p>
<div class="message-attachment"
>
<div class="service-name">Meetup</div>



<div class="link-title"><a href="https://www.meetup.com/boston-data-lineage-meetup-group/events/298893366/">Data Lineage Meetup @ Microsoft New England, Tue, Mar 19, 2024, 5:30 PM | Meetup</a></div>
<div class="link-text">
This will be a hybrid event over Zoom and in-person:

Michael Robinson, Community Manager for OpenLineage, will be presenting 2023: A year in review

Sheeri Cabral, Product
</div>



<a href="https://www.meetup.com/boston-data-lineage-meetup-group/events/298893366/">
<img class="preview" src="https://secure.meetupstatic.com/photos/event/3/8/5/600_518820901.jpeg"
width="600"
height="338" />
</a>


<div class="print-only">Original URL: https://www.meetup.com/boston-data-lineage-meetup-group/events/298893366/</div>



</div>



</div>
</div>
</div>
</div>



</div>
</div>

Expand Down
26 changes: 25 additions & 1 deletion channel/dagster-integration/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,18 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../github-discussions/index.html">
# github-discussions
</a>
</li>

<li class="channel">
<a href="../github-notifications/index.html">
# github-notifications
</a>
</li>

<li class="channel">
<a href="../gx-integration/index.html">
# gx-integration
Expand Down Expand Up @@ -94,6 +106,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../spark-support-multiple-scala-versions/index.html">
# spark-support-multiple-scala-versions
</a>
</li>

<li class="channel">
<a href="../spec-compliance/index.html">
# spec-compliance
Expand All @@ -106,6 +124,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../user-generated-metadata/index.html">
# user-generated-metadata
</a>
</li>

</ul>
<h3 id="group-title">Private Channels</h3>
<ul class="list" id="group-list">
Expand Down Expand Up @@ -1499,7 +1523,7 @@ <h3 id="mpim-title">Group Direct Messages</h3>
&lt;p&gt;• In order to fit with other assets yielded by Dagster, the AssetKey should be 100% human readable (i.e. no UUIDs and have a hierarchy that makes sense).
• The created AssetKey should be idempotent. A dataset with the same namespace/name should produce the same key so dagster can relate the assets to one another. A dataset is identified by its namespace and name and the asset should be too.
• The AssetMaterialization (most likely the AssetKey) should contain a sufficiently unique identifier so other assets are not mistakenly identified as an OpenLineage dataset.
• A good option for the AssetKey limitations could be [&#34;OpenLineage&#34;, &#34;InputDataset &lt;em&gt;OR&lt;/em&gt; OutputDataset &lt;em&gt;OR&lt;/em&gt; Dataset&#34;, &#34;&amp;lt;dataset.namespace&amp;gt;&#34;, &#34;&amp;lt;dataset.name&amp;gt;&#34;] &lt;br /&gt;
• A good option for the AssetKey limitations could be [&#34;OpenLineage&#34;, &#34;InputDataset &lt;em&gt;OR&lt;/em&gt; OutputDataset &lt;em&gt;OR&lt;/em&gt; Dataset&#34;, &#34;&amp;lt;dataset.namespace&amp;gt;&#34;, &#34;&amp;lt;dataset.name&amp;gt;&#34;]&lt;br /&gt;
This approach is human readable, idempotent, and is a sufficiently unique identifier (assuming other assets beginning with OpenLineage &amp;gt; Dataset are not being created elsewhere).&lt;/p&gt;
</div>

Expand Down
50 changes: 50 additions & 0 deletions channel/data-council-meetup/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,18 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../github-discussions/index.html">
# github-discussions
</a>
</li>

<li class="channel">
<a href="../github-notifications/index.html">
# github-notifications
</a>
</li>

<li class="channel">
<a href="../gx-integration/index.html">
# gx-integration
Expand Down Expand Up @@ -94,6 +106,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../spark-support-multiple-scala-versions/index.html">
# spark-support-multiple-scala-versions
</a>
</li>

<li class="channel">
<a href="../spec-compliance/index.html">
# spec-compliance
Expand All @@ -106,6 +124,12 @@ <h3 id="channel-title">Public Channels</h3>
</a>
</li>

<li class="channel">
<a href="../user-generated-metadata/index.html">
# user-generated-metadata
</a>
</li>

</ul>
<h3 id="group-title">Private Channels</h3>
<ul class="list" id="group-list">
Expand Down Expand Up @@ -409,6 +433,32 @@ <h3 id="mpim-title">Group Direct Messages</h3>





<div class="message-container channel_join ">
<div id="2024-02-03 20:14:01">

<img src="https://avatars.slack-edge.com/2024-02-03/6580991550434_1cf74f1de22cb9502f17_72.jpg" class="user_icon" />


<div class="message">

<div class="username">Josh Fischer
<span class="print-only user-email">([email protected])</span>
</div>
<a href="#2024-02-03 20:14:01"><div class="time">2024-02-03 20:14:01</div></a>
<div class="msg">
<p>@Josh Fischer has joined the channel</p>



</div>
</div>
</div>
</div>



</div>
</div>

Expand Down
Loading

0 comments on commit 6df6d06

Please sign in to comment.