Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weekly Digest (5 January, 2020 - 12 January, 2020) #3119

Closed
weekly-digest bot opened this issue Jan 12, 2020 · 0 comments
Closed

Weekly Digest (5 January, 2020 - 12 January, 2020) #3119

weekly-digest bot opened this issue Jan 12, 2020 · 0 comments

Comments

@weekly-digest
Copy link

weekly-digest bot commented Jan 12, 2020

Here's the Weekly Digest for iterative/dvc:


ISSUES

Last week 56 issues were created.
Of these, 37 issues have been closed and 19 issues are still open.

OPEN ISSUES

💚 #3111 api: open doesn't work with private GH repo (SSH URL), by jorgeorpinel
💚 #3110 refactor: use ABC's for Remote base class instead of a plain object, by mroutis
💚 #3109 refactor: use relative imports instead of absolute ones, by mroutis
💚 #3108 api: use only kwargs, by mroutis
💚 #3107 cannot rebase if a new file is created which is not present in .gitignore in the base branch, by ankurrajdev
💚 #3105 dvc get can can delete the current directory, by Persedes
💚 #3102 Easy way to update existing DVC-file for "run" stage, by PavelKovalets
💚 #3101 summon: fixes and dvcx prereq, by Suor
💚 #3098 HttpError 400 when pushing to Google Drive, by RomanVeretenov
💚 #3095 Perf improvement for Windows share, by rxxg
💚 #3092 api: inline documentation (docstrings), by jorgeorpinel
💚 #3088 [WIP] dvc: add sanity checks for hard/symlinks, by efiop
💚 #3087 Can't pull a .dvc file after dvc import, by JPFrancoia
💚 #3084 perf: copy cache operations very slow on network drive, by rxxg
💚 #3080 Hardlinks not correctly detected on SMB network share (NTFS?), by rxxg
💚 #3079 summon api: call python code from the user side, by dmpetrov
💚 #3069 Support hashings other than MD5, by adrinjalali
💚 #3062 summon api: caching during interactive sessions, by dmpetrov
💚 #3060 UI progress, by casperdcl

CLOSED ISSUES

❤️ #3113 [WIP] fix test failures when submitting from upstream branches, by efiop
❤️ #3112 [WIP] fix test failures, by efiop
❤️ #3106 Restyle get: handle non-DVC repositories, by restyled-io[bot]
❤️ #3104 tests: remove redundant native ssh tests, by efiop
❤️ #3103 Restyle get: handle non-DVC repositories, by restyled-io[bot]
❤️ #3100 update: tests: migrate to dir helpers, by pared
❤️ #3099 stage: tests: migrate to dir helpers, by pared
❤️ #3097 get: handle non-DVC repositories, by fabiosantoscode
❤️ #3096 state: tests: migrate to dir helpers, by pared
❤️ #3094 run: tests: migrate to dir helpers, by pared
❤️ #3093 Move fs utilities to fs.py from init.py, by algomaster99
❤️ #3091 repro: tests: migrate to dir helpers, by pared
❤️ #3090 py3: use links from os module, by mroutis
❤️ #3089 get: handle non-DVC repositories, by shcheklein
❤️ #3086 remote: test: migrate to dir helpers, by pared
❤️ #3085 pipeline: test: migrate to dir helpers, by pared
❤️ #3083 output: tests: migrate to dir helpers, by pared
❤️ #3082 setup: get rid of py2 reqs, by efiop
❤️ #3081 pyarrow: bump version, by mroutis
❤️ #3078 py3: use format_exc instead of print_exception, by mroutis
❤️ #3077 get/import: help output should reflect non-DVC Git repo support, by jorgeorpinel
❤️ #3076 rwlock: flush and fsync, by efiop
❤️ #3075 rwlock: check that .dvc/lock is locked, by efiop
❤️ #3074 install: tests: migrate to dir helpers, by pared
❤️ #3073 test: merge _should_test_aws and _get_aws_url inside S3 test helper, by skshetry
❤️ #3072 import url: test: migrate to dir helpers, by pared
❤️ #3071 test: merge _should_test_oss and _get_oss_url inside OSS test helper, by skshetry
❤️ #3070 http/ imp tests - migrate do dir helpers, by pared
❤️ #3068 dependency: test: migrate to dir helpers, by pared
❤️ #3067 cache: test: migrate to dir helpers, by pared
❤️ #3066 analytics: tests: migrate to dir helpers, by pared
❤️ #3065 Restyle dvc: update gc to remove unpacked dir, by restyled-io[bot]
❤️ #3064 fix snap deploy stage, by casperdcl
❤️ #3063 Snap classic deployment, by casperdcl
❤️ #3061 completion: fix --relink problem, by mroutis
❤️ #3059 logger: use py3 methods to display the exception, by mroutis
❤️ #3058 ui: don't show exception for "Too many files" error, by efiop

LIKED ISSUE

👍 #3077 get/import: help output should reflect non-DVC Git repo support, by jorgeorpinel
It received 👍 x2, 😄 x0, 🎉 x0 and ❤️ x0.

NOISY ISSUE

🔈 #3080 Hardlinks not correctly detected on SMB network share (NTFS?), by rxxg
It received 24 comments.


PULL REQUESTS

Last week, 48 pull requests were created, updated or merged.

UPDATED PULL REQUEST

Last week, 10 pull requests were updated.
💛 #3101 summon: fixes and dvcx prereq, by Suor
💛 #3095 Perf improvement for Windows share, by rxxg
💛 #3088 [WIP] dvc: add sanity checks for hard/symlinks, by efiop
💛 #3051 [WIP] metrics: introduce diff, by efiop
💛 #3017 [WIP] point to troubleshooting guide on too many open files error, by pared
💛 #2993 commands/update: add --rev option, by ilgooz
💛 #2975 add: auto convert absolute_path => relative, by casperdcl
💛 #2957 [WIP][Showcase] dvc: use dynamic scope to stop callback/flag passing, by Suor
💛 #2956 [WIP] add snap tests, by casperdcl
💛 #2846 UI progress cleanup, by casperdcl

MERGED PULL REQUEST

Last week, 38 pull requests were merged.
💜 #3104 tests: remove redundant native ssh tests, by efiop
💜 #3100 update: tests: migrate to dir helpers, by pared
💜 #3099 stage: tests: migrate to dir helpers, by pared
💜 #3097 get: handle non-DVC repositories, by fabiosantoscode
💜 #3096 state: tests: migrate to dir helpers, by pared
💜 #3094 run: tests: migrate to dir helpers, by pared
💜 #3093 Move fs utilities to fs.py from init.py, by algomaster99
💜 #3091 repro: tests: migrate to dir helpers, by pared
💜 #3090 py3: use links from os module, by mroutis
💜 #3086 remote: test: migrate to dir helpers, by pared
💜 #3085 pipeline: test: migrate to dir helpers, by pared
💜 #3083 output: tests: migrate to dir helpers, by pared
💜 #3082 setup: get rid of py2 reqs, by efiop
💜 #3078 py3: use format_exc instead of print_exception, by mroutis
💜 #3076 rwlock: flush and fsync, by efiop
💜 #3075 rwlock: check that .dvc/lock is locked, by efiop
💜 #3074 install: tests: migrate to dir helpers, by pared
💜 #3073 test: merge _should_test_aws and _get_aws_url inside S3 test helper, by skshetry
💜 #3072 import url: test: migrate to dir helpers, by pared
💜 #3071 test: merge _should_test_oss and _get_oss_url inside OSS test helper, by skshetry
💜 #3070 http/ imp tests - migrate do dir helpers, by pared
💜 #3068 dependency: test: migrate to dir helpers, by pared
💜 #3067 cache: test: migrate to dir helpers, by pared
💜 #3066 analytics: tests: migrate to dir helpers, by pared
💜 #3064 fix snap deploy stage, by casperdcl
💜 #3063 Snap classic deployment, by casperdcl
💜 #3061 completion: fix --relink problem, by mroutis
💜 #3058 ui: don't show exception for "Too many files" error, by efiop
💜 #3055 test: Merge _should_test_azure and _get_azure_url inside Azure test helper, by skshetry
💜 #3054 dvc: update gc to remove unpacked dir, by sharidas
💜 #3053 dvc: optimize Git.is_tracked(), by Suor
💜 #3049 tests: remote: local: migrate to dir fixtures, by pared
💜 #3044 tests: api: convert to dir helpers, by pared
💜 #3035 Write test for walk_files to check if it accepts Path-like and str objects, by algomaster99
💜 #3034 py3: remove code related to py2 limitations, by mroutis
💜 #3027 ui: warn about ignored options for dvc status and a grammar fix, by Suor
💜 #3020 import: allow importing from non-DVC git repositories, by chatcannon
💜 #3018 local-related methods should verify that WorkingTree is in use, by pared


COMMITS

Last week there were 119 commits.
🛠️ Merge pull request #3076 from efiop/rwlock_sync rwlock: flush and fsync by efiop
🛠️ gdrive: add support for teamDriveId by MaxRis
🛠️ Merge pull request #3097 from fabiosantoscode/feature/3089-get-non-dvc-repositories get: handle non-DVC repositories by efiop
🛠️ Merge pull request #3094 from pared/2896_run run: tests: migrate to dir helpers by efiop
🛠️ Merge pull request #3096 from pared/2896_state state: tests: migrate to dir helpers by efiop
🛠️ Merge pull request #3100 from pared/2896_update update: tests: migrate to dir helpers by efiop
🛠️ Merge pull request #3099 from pared/2896_stage stage: tests: migrate to dir helpers by efiop
🛠️ Merge pull request #3104 from efiop/ssh_dir_out tests: remove redundant native ssh tests by efiop
🛠️ pyinstaller: remove Crypto hook by efiop
🛠️ build: use build-requirements.txt by efiop
🛠️ pyinstaller: delete oss hook It is already available in the standard hooks. by efiop
🛠️ tests: use mocked ssh by efiop
🛠️ ssh: fix bug in remove() by efiop
🛠️ tests: remove redundant native ssh tests We already have mocked ones, which are more reliable as they use their own paramiko server instead of relying on the sshd running on the test machine. Native tests are also quite flaky and fail sometimes due to network issues. by efiop
🛠️ Merge pull request #3090 from mroutis/py3-system py3: use links from os module by efiop
🛠️ don't reimport DvcException by mroutis
🛠️ py3: fspath source and link_name by mroutis
🛠️ system: catch OSError instead of Exception by mroutis
🛠️ test removing a file outside a raw git repo by fabiosantoscode
🛠️ deduplicate code by fabiosantoscode
🛠️ don't manually clean up git repository by fabiosantoscode
🛠️ forbid absolute paths for plain git repositories by fabiosantoscode
🛠️ remove blank line by fabiosantoscode
🛠️ run black by fabiosantoscode
🛠️ get: leverage external_repo() context manager for DVC repositories by fabiosantoscode
🛠️ import: update documentation Fixes #3077 by fabiosantoscode
🛠️ Update dvc/command/get.py Co-Authored-By: Jorge Orpinel [email protected] by fabiosantoscode
🛠️ Update dvc/command/get.py Co-Authored-By: Jorge Orpinel [email protected] by fabiosantoscode
🛠️ Update dvc/command/get.py Co-Authored-By: Jorge Orpinel [email protected] by fabiosantoscode
🛠️ Update dvc/command/get.py Co-Authored-By: Jorge Orpinel [email protected] by fabiosantoscode
🛠️ change command doc string by fabiosantoscode
🛠️ remove unused exception class by fabiosantoscode
🛠️ Revert "get: recoup cache optimal location" This reverts commit 8e4922800f6ce47210976764af1c05e31e90deac. by fabiosantoscode
🛠️ Update dvc/repo/get.py Co-Authored-By: Ruslan Kuprieiev [email protected] by fabiosantoscode
🛠️ get: recoup cache optimal location by fabiosantoscode
🛠️ doc: change get documentation so that it doesn't imply the target must be DVC enabled by fabiosantoscode
🛠️ style: improve code flow and move comments by fabiosantoscode
🛠️ get: handle non-DVC repositories Allows us to dvc get from non-DVC source repositories. Fixes #3089 by fabiosantoscode
🛠️ Merge pull request #3091 from pared/2896_repro repro: tests: migrate to dir helpers by efiop
🛠️ run: tests: remove deterministic_run fixture by pared
🛠️ run: tests: clumsy deterministic_run migration by pared
🛠️ run: tests: migrate to helpers all besides deterministic by pared
🛠️ update: tests: migrate to dir helpers by pared
🛠️ stage: tests: migrate to dir helpers by pared
🛠️ state: tests: migrate to dir helpers by pared
🛠️ Merge pull request #3053 from Suor/is-tracked dvc: optimize Git.is_tracked() by efiop
🛠️ Merge pull request #3093 from iterative/move-fs-utilities Move fs utilities to fs.py from init.py by efiop
🛠️ Merge pull request #3072 from pared/2896_import_url import url: test: migrate to dir helpers by efiop
🛠️ repro: tests: use Path-like objects in repro_dir fixture by pared
🛠️ repro: tests: yield dict of stages from repro_dir by pared
🛠️ Move walk_files to fs.py by algomaster99
🛠️ Update tests/func/test_import_url.py Co-Authored-By: Ruslan Kuprieiev [email protected] by pared
🛠️ Move copyfile to fs.py by algomaster99
🛠️ Move makedirs to fs.py by algomaster99
🛠️ Update tests/func/test_import_url.py Co-Authored-By: Ruslan Kuprieiev [email protected] by pared
🛠️ Update tests/func/test_import_url.py Co-Authored-By: Ruslan Kuprieiev [email protected] by pared
🛠️ repro: tests: refactor for readibility by pared
🛠️ repro: tests: migrate to dir helpers by pared
🛠️ Merge pull request #3083 from pared/2896_output output: tests: migrate to dir helpers by efiop
🛠️ py3: use links from os module by mroutis
🛠️ Merge pull request #3034 from mroutis/remove-py2-comments py3: remove code related to py2 limitations by efiop
🛠️ Merge pull request #3086 from pared/2896_remote remote: test: migrate to dir helpers by efiop
🛠️ Merge pull request #3085 from pared/2896_pipeline pipeline: test: migrate to dir helpers by efiop
🛠️ remote: test: migrate to dir helpers by pared
🛠️ pipeline: test: migrate to dir helpers by pared
🛠️ output: tests: migrate to dir helpers by pared
🛠️ import url: test: migrate to dir helpers by pared
🛠️ Merge pull request #3074 from pared/2896_install install: tests: migrate to dir helpers by efiop
🛠️ Merge pull request #3082 from efiop/reqs setup: get rid of py2 reqs by efiop
🛠️ setup: get rid of py2 reqs by efiop
🛠️ Merge pull request #3078 from mroutis/py3-logger py3: use format_exc instead of print_exception by efiop
🛠️ Merge pull request #3075 from efiop/assert_stage rwlock: check that .dvc/lock is locked by efiop
🛠️ Merge pull request #3027 from Suor/status-noop ui: warn about ignored options for dvc status and a grammar fix by efiop
🛠️ ui: fix grammar in the error message by Suor
🛠️ ui: error out for meaningless options for non-cloud dvc status by Suor
🛠️ fixup by pared
🛠️ install: tests: migrate to dir helpers by pared
🛠️ py3: remove tb_list by mroutis
🛠️ py3: use format_exc instead of print_exception by mroutis
🛠️ py3: remove code related to py2 limitations by mroutis
🛠️ Merge pull request #3058 from efiop/too_many_files ui: don't show exception for "Too many files" error by efiop
🛠️ Merge pull request #3035 from iterative/test-walk_files Write test for walk_files to check if it accepts Path-like and str objects by efiop
🛠️ Write test for walk_files to check if it accepts Path-like and str objects by algomaster99
🛠️ rwlock: flush and fsync It is important that we ensure that rwlocked contents are flushed to disk, because otherwise other rwlock readers might get outdated state. Kudos @shcheklein for catching this one. by efiop
🛠️ rwlock: check that .dvc/lock is locked Mostly a sanity check, but we did have a potential bug in destroy, whcih this PR fixes along the way. Kudos @shcheklein for catching this one. by efiop
🛠️ Merge pull request #3064 from casperdcl/snap-deploy fix snap deploy stage by efiop
🛠️ snap deploy master edge partially reverts f21931cca0bcaab55f221cba37e5ab9133606f85 by casperdcl
🛠️ Merge pull request #3054 from sharidas/fix-gc-local dvc: update gc to remove unpacked dir by efiop
🛠️ travis: deploy snap only on tags. by efiop
🛠️ Merge pull request #3073 from skshetry/refactor-remote-s3 test: merge _should_test_aws and _get_aws_url inside S3 test helper by efiop
🛠️ Merge branch 'master' into refactor-remote-s3 by efiop
🛠️ Merge pull request #3071 from skshetry/refactor-remote-oss test: merge _should_test_oss and _get_oss_url inside OSS test helper by efiop
🛠️ Merge pull request #3070 from pared/2896_http_imp http/ imp tests - migrate do dir helpers by efiop
🛠️ Merge pull request #3068 from pared/2896_dependency dependency: test: migrate to dir helpers by efiop
🛠️ Merge pull request #3067 from pared/2896_cache cache: test: migrate to dir helpers by efiop
🛠️ dvc: update gc to remove unpacked dir In local remote its found that gc does not remove the unpacked dir. This change set helps to remove it. Signed-off-by: Sujith H [email protected] by sharidasan
🛠️ travis: deploy snap only on master by efiop
🛠️ Merge pull request #3066 from pared/2896_analytics analytics: tests: migrate to dir helpers by efiop
🛠️ config: update command for setting default remote by efiop
🛠️ test: merge _should_test_aws and _get_aws_url inside S3 test helper by skshetry
🛠️ imp/imp_url cmd test: remove unnecessary dvc fixture by pared
🛠️ http/ imp tests - migrate do dir helpers by pared
🛠️ dependency: test: migrate to dir helpers by pared
🛠️ cache: test: migrate to dir helpers by pared
🛠️ analytics: tests: migrate to dir helpers by pared
🛠️ Merge pull request #3044 from pared/2896_api tests: api: convert to dir helpers by efiop
🛠️ Merge pull request #3063 from casperdcl/snap-classic Snap classic deployment by efiop
🛠️ remove unneeded stage by casperdcl
🛠️ integrate snap deploy by casperdcl
🛠️ Snap classic approval! - approval: https://forum.snapcraft.io/t/classic-confinement-request-for-dvc/14124 - partially reverts commit a0ac129d5fbba4b491033d4a397a2ad02dccccfb. by casperdcl
🛠️ Merge pull request #3061 from mroutis/fix-zsh completion: fix --relink problem by efiop
🛠️ ui: don't show exception for "Too many files" error https://github.com/iterative/dvc.org/pull/875#discussion_r362920851 Stops showing the exception in non-verbose mode, but shows full traceback in verbose mode. Introducing our custom parameter tb_only through standard extra logging parameter. by efiop
🛠️ Merge pull request #3018 from pared/2914_3 local-related methods should verify that WorkingTree is in use by efiop
🛠️ completion: fix --relink problem Close #2983 by mroutis
🛠️ Merge pull request #3049 from pared/2896_remote_local tests: remote: local: migrate to dir fixtures by efiop
🛠️ Merge pull request #3020 from chatcannon/dvc-import-regular-git import: allow importing from non-DVC git repositories by efiop
🛠️ test: merge _should_oss_azure and _get_oss_url inside OSS class by skshetry
🛠️ Merge pull request #3055 from skshetry/refactor-remote-azure test: Merge _should_test_azure and _get_azure_url inside Azure test helper by efiop
🛠️ Merge branch 'master' into refactor-remote-azure by efiop


CONTRIBUTORS

Last week there were 10 contributors.
👤 efiop
👤 MaxRis
👤 mroutis
👤 fabiosantoscode
👤 pared
👤 algomaster99
👤 Suor
👤 casperdcl
👤 sharidasan
👤 skshetry


STARGAZERS

Last week there were 43 stagazers.
mohamed-ali
amirouche
dclong
lifeixiang027
Accio
vanzaj
vtrokhymenko
yunfan
boonepeter
antecessor
Mpic
pasndrp
rlizzo
ogamaxwell
kslader8
tezheng
jsxs0
tekrei
prsrepo
cedricgoubard
bgheneti
tdrobbin
Frost-Lee
caogang1213
Pebaz
asis-shukla
CustomPoint
Sasa33
evereq
shyamsn97
vikivivi
karajan1001
xmagpie
paq
JohannesHa
RaSiel93
davidbgk
chrisfyk
cot246
QSCTech-Sange
KrishnaPG
ShashKash
slamer59
You all are the stars! 🌟


RELEASES

Last week there were no releases.


That's all for last week, please 👀 Watch and Star the repository iterative/dvc to receive next weekly updates. 😃

You can also view all Weekly Digests by clicking here.

Your Weekly Digest bot. 📆

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant