Skip to content

Complete: Mihir: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset#106

Closed
hasanahmedfaisal wants to merge 2 commits intoswarooprm:mainfrom
hasanahmedfaisal:task1193-1200_allenairealtoxicityprompts
Closed

Complete: Mihir: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset#106
hasanahmedfaisal wants to merge 2 commits intoswarooprm:mainfrom
hasanahmedfaisal:task1193-1200_allenairealtoxicityprompts

Conversation

@hasanahmedfaisal
Copy link

No description provided.

@swarooprm
Copy link
Owner

@shailaja183, wondering if you can help review this PR?

@swarooprm
Copy link
Owner

@kuntalkumarpal, wondering if you can help review this PR?

@swarooprm swarooprm changed the title Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Kuntal: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Sep 22, 2021
@swarooprm
Copy link
Owner

@Mihir3009, can you help review these tasks?

@swarooprm swarooprm changed the title Kuntal: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Mihir: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Sep 25, 2021
@Mihir3009
Copy link

Quick suggestions:

  1. Change all tasks to "classification" problem. Here is what you can do:

Example for toxicity:
For any score decide the threshold and say if the score>threshold then it's "Toxic", otherwise "Not Toxic". (Use text label rather than '0', '1').

  1. Change category, definition and readme accordingly.

@hasanahmedfaisal
Copy link
Author

hasanahmedfaisal commented Oct 18, 2021

Sorry for replying this late, but assuming for all the scores greater than 0.5 should be toxic otherwise non-toxic?

@hasanahmedfaisal
Copy link
Author

I have used 0.5 as threshold and made relevant changes, can you have a look at it

@swarooprm
Copy link
Owner

Your HW2 is complete now.

Would you like to submit the same tasks to our big project repo https://github.com/allenai/natural-instructions-expansion/pulls? You just need to fork that repo, rename tasks starting from the latest number in the repo and create PR there. This way, you can be part of our research on "learning from instructions instead of learning from examples (conventional machine learning)". This is purely optional and your HW2 grade does not depend on this @hasanahmedfaisal

if you decide to submit, please do it as soon as possible.

@swarooprm swarooprm closed this Oct 29, 2021
@swarooprm swarooprm changed the title Mihir: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Complete: Mihir: Task 1193-1200: AllenAi Real Toxicity Prompts Dataset Oct 29, 2021
@hasanahmedfaisal
Copy link
Author

hasanahmedfaisal commented Oct 29, 2021

@swarooprm I had submitted the PR to the above repo. Can you check if everything is fine?
This is the link: [https://github.com/allenai/natural-instructions/pull/495]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants