Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve the bulk annotation process, specially for multi-label text classification #2264

Closed
4 tasks done
frascuchon opened this issue Jan 31, 2023 · 1 comment · Fixed by #2437
Closed
4 tasks done

Improve the bulk annotation process, specially for multi-label text classification #2264

frascuchon opened this issue Jan 31, 2023 · 1 comment · Fixed by #2437
Assignees
@leiyre @keithCuniah
Labels
type: enhancement Indicates new feature requests
Milestone
v1.4.0

Comments

@frascuchon
Copy link
Member

frascuchon commented Jan 31, 2023 •
edited by keithCuniah
Loading

Description

The main effort on the bulk annotation will be to tackle the following tasks:

  • Normalize the 2-step validation flow for all the tasks, except the single label text classification
  • Enhance the bulk annotation labeling for multi-label text classification
  • Disable automatic validation for multi-label text classification

Tasks

Refs
@frascuchon frascuchon added the type: enhancement Indicates new feature requests label Jan 31, 2023
@frascuchon frascuchon changed the title Improve the Improve the bulk annotation process, specially for multi-label text classification Jan 31, 2023
@leiyre leiyre mentioned this issue Feb 1, 2023
Merged
7 tasks
leiyre added a commit that referenced this issue Feb 1, 2023
@leiyre
feat: Two steps validation for multilabel (#2273)
3701c4e 
# Description

Move records to PENDING status (instead of VALIDATED) when a labels
change in multilabel Text Classifier

Closes #2265
See #2264

Note :  this will also correct this issue #2160 

**Type of change**

(Please delete options that are not relevant. Remember to title the PR
according to the type of change)

- [x] New feature (non-breaking change which adds functionality)

**How Has This Been Tested**

(Please describe the tests that you ran to verify your changes. And
ideally, reference `tests`)

- [x] update ClassifierAnnotationArea

**Checklist**

- [x] I have merged the original branch into my forked branch
- [x] follows the style guidelines of this project
- [x] I did a self-review of my code
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works
@leiyre leiyre mentioned this issue Feb 2, 2023
Merged
8 tasks
leiyre added a commit that referenced this issue Feb 3, 2023
@leiyre
feat: Unify record-level actions for all tasks (Validate, Clear, and …
0711540 
…Discard) (#2280)

# Description

This PR aligns record-level actions for all tasks (Validate, Clear, and
Discard) and include the new design

Closes #2266
See #2264

**Type of change**

(Please delete options that are not relevant. Remember to title the PR
according to the type of change)

- [x] New feature (non-breaking change which adds functionality)

**How Has This Been Tested**

(Please describe the tests that you ran to verify your changes. And
ideally, reference `tests`)

- [x] test for RecordActionButtons
- [x] update snapshot

**Checklist**

- [x] I have merged the original branch into my forked branch
- [x] follows the style guidelines of this project
- [x] I did a self-review of my code
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works
@frascuchon frascuchon added this to the v1.4.0 milestone Feb 7, 2023
@frascuchon frascuchon mentioned this issue Feb 9, 2023
Closed
@Amelie-V
Copy link
Member

General comments:

Single label:

  • Remove Clear and Reset action

Bulk Multilabel:

Make evident the step to validate the selected records :

  • Improving the validated icon behaviour.
  • Reviewing Text for: "Apply button", "Info message", "Toast messagex2".

Record card:

  • Order: Validate, Discard, Clear, Reset
  • Validate is the primary button: Green background + icon
  • Discard, Clear, and Reset are secondary: Neutral bg and border-colour + icon (we can maintain the colour on the icon)
  • Maintain default state in all secondary button
  • When the record is validated, the "Validate" button is disabled.
  • Align icon size between bulk list and record
  • Reduce the size button

@leiyre leiyre mentioned this issue Feb 14, 2023
Merged
7 tasks
leiyre added a commit that referenced this issue Feb 16, 2023
@leiyre
feat: Allow to reset record (#2338)
00e0efc 
# Description

This PR includes reset button at record level and as global action to to
allow resetting the record to previous status and annotation

Closes #2278
See #2264

**Type of change**

- [x] New feature (non-breaking change which adds functionality)

**How Has This Been Tested**

- [x] Update recordActionButtons test

**Checklist**

- [x] I have merged the original branch into my forked branch
- [x] follows the style guidelines of this project
- [x] I did a self-review of my code
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works

---------

Co-authored-by: keithCuniah <[email protected]>
@leiyre leiyre mentioned this issue Feb 28, 2023
Merged
15 tasks
frascuchon pushed a commit that referenced this issue Mar 8, 2023
@leiyre @keithCuniah
feat: Bulk annotation improvement (#2437)
3fce915 
# Description

This PR improves annotation at record level and at bulk level for the
three different tasks

- Normalize the 2-step validation flow for all the tasks, except the
single label text classification
- Enhance the bulk annotation labeling for multi-label text
classification
- Disable automatic validation for multi-label text classification
- Include reset and clear for all task
- New styles

Closes [#2264](#2264)

**Type of change**

(Please delete options that are not relevant. Remember to title the PR
according to the type of change)

- [ ] Bug fix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- [ ] Refactor (change restructuring the codebase without changing
functionality)
- [ ] Improvement (change adding some improvement to an existing
functionality)
- [ ] Documentation update

**How Has This Been Tested**

(Please describe the tests that you ran to verify your changes. And
ideally, reference `tests`)

- [ ] Test A
- [ ] Test B

**Checklist**

- [x] I have merged the original branch into my forked branch
- [ ] I added relevant documentation
- [x] follows the style guidelines of this project
- [x] I did a self-review of my code
- [ ] I made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [x] I have added tests that prove my fix is effective or that my
feature works

---------

Co-authored-by: Keith Cuniah <[email protected]>
Co-authored-by: keithCuniah <[email protected]>
@frascuchon frascuchon mentioned this issue Mar 8, 2023
Merged
frascuchon added a commit that referenced this issue Mar 9, 2023
@frascuchon
Release 1.4.0 (#2500)
cf75dd5 
# [1.4.0](v1.3.1...v1.4.0)
(2023-03-09)

### Features

* `configure_dataset` accepts a workspace as argument
([#2503](#2503))
([29c9ee3](29c9ee3)),
* Add `active_client` function to main argilla module
([#2387](#2387))
([4e623d4](4e623d4)),
closes [#2183](#2183)
* Add text2text support for prepare for training spark nlp
([#2466](#2466))
([21efb83](21efb83)),
closes [#2465](#2465)
[#2482](#2482)
* Allow passing workspace as client param for `rg.log` or `rg.load`
([#2425](#2425))
([b3b897a](b3b897a)),
closes [#2059](#2059)
* Bulk annotation improvement
([#2437](#2437))
([3fce915](3fce915)),
closes [#2264](#2264)
* Deprecate `chunk_size` in favor of `batch_size` for `rg.log`
([#2455](#2455))
([3ebea76](3ebea76)),
closes [#2453](#2453)
* Expose `batch_size` parameter for `rg.load`
([#2460](#2460))
([e25be3e](e25be3e)),
closes [#2454](#2454)
[#2434](#2434)
* Extend shortcuts to include alphabet for token classification
([#2339](#2339))
([4a92b35](4a92b35))


### Bug Fixes

* added flexible app redirect to docs page
([#2428](#2428))
([5600301](5600301)),
closes [#2377](#2377)
* added regex match to set workspace method
([#2427](#2427))
([d789fa1](d789fa1)),
closes [#2388]
* error when loading record with empty string query
([#2429](#2429))
([fc71c3b](fc71c3b)),
closes [#2400](#2400)
[#2303](#2303)
* Remove extra-action dropdown state after navigation
([#2479](#2479))
([9328994](9328994)),
closes [#2158](#2158)


### Documentation

* Add AutoTrain to readme
([7199780](7199780))
* Add migration to label schema section
([#2435](#2435))
([d57a1e5](d57a1e5)),
closes [#2003](#2003)
[#2003](#2003)
* Adds zero+few shot tutorial with SetFit
([#2409](#2409))
([6c679ad](6c679ad))
* Update readme with quickstart section and new links to guides
([#2333](#2333))
([91a77ad](91a77ad))


## As always, thanks to our amazing contributors!
- Documentation update: adding missing n (#2362) by @Gnonpi
- feat: Extend shortcuts to include alphabet for token classification
(#2339) by @cceyda
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@leiyre leiyre

@keithCuniah keithCuniah

Labels
type: enhancement Indicates new feature requests
Projects
None yet
Milestone
v1.4.0
Development

Successfully merging a pull request may close this issue.

feat: Bulk annotation improvement argilla-io/argilla
4 participants
@frascuchon @leiyre @Amelie-V @keithCuniah