jsaizant commited on
Commit
3716c61
·
verified ·
1 Parent(s): 64195e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -506,8 +506,8 @@ especially if the content originates from less-regulated sources or user-generat
506
  **How was the data collected?**
507
 
508
  This dataset is constituted by combining several sources, whose acquisition methods can be classified into three groups:
509
- - Web-sourced datasets with some preprocessing available under permissive license (p.e. Common Crawl).
510
- - Domain-specific or language-specific raw crawls, always respecting robots.txt (p.e. Spanish Crawling).
511
  - Manually curated data obtained through collaborators, data providers (by means of legal assignment agreements) or open source projects
512
  (p.e. CATalog).
513
 
@@ -560,7 +560,7 @@ The original raw data was not kept.
560
 
561
  **Is the software that was used to preprocess/clean/label the data available? If so, please provide a link or other access point.**
562
 
563
- Yes, the preprocessing and filtering software is open-sourced. The [CURATE](https://github.com/langtech-bsc/CURATE) pipeline was used for Spanish Crawling and CATalog,
564
  and the [Ungoliant](https://github.com/oscar-project/ungoliant) pipeline was used for the OSCAR project.
565
 
566
  #### Uses
 
506
  **How was the data collected?**
507
 
508
  This dataset is constituted by combining several sources, whose acquisition methods can be classified into three groups:
509
+ - Web-sourced datasets with some preprocessing available under permissive license.
510
+ - Domain-specific or language-specific raw crawls, always respecting robots.txt.
511
  - Manually curated data obtained through collaborators, data providers (by means of legal assignment agreements) or open source projects
512
  (p.e. CATalog).
513
 
 
560
 
561
  **Is the software that was used to preprocess/clean/label the data available? If so, please provide a link or other access point.**
562
 
563
+ Yes, the preprocessing and filtering software is open-sourced. The [CURATE](https://github.com/langtech-bsc/CURATE) pipeline was used for CATalog and other curated sources,
564
  and the [Ungoliant](https://github.com/oscar-project/ungoliant) pipeline was used for the OSCAR project.
565
 
566
  #### Uses