purl-next: Collect PURLs for CPAN Perl packages #685

Activity

1. pombredanne

   added a parent issue on Sep 5, 2025

   • purl-next: Create decentralized, distributed PURL metadata collection #655
2. github-project-automation

   added this to 00-AboutCodePlanneron Sep 5, 2025
3. pombredanne

   added the

   Feature

   issue type on Sep 5, 2025
4. pombredanne

   moved this to Needs prep in 00-AboutCodePlanneron Sep 5, 2025
5. pombredanne

   changed the title [-]Collect PURLs from cpan[/-] [+]purl-next: Collect PURLs from cpan[/+] on Sep 5, 2025
6. pombredanne

   changed the title [-]purl-next: Collect PURLs from cpan[/-] [+]purl-next: Collect PURLs for CPAN Perl packages[/+] on Sep 5, 2025
7. pombredanne

   changed the title [-]purl-next: Collect PURLs for CPAN Perl packages[/-] [+]Collect PURLs for CPAN Perl packages[/+] on Sep 5, 2025
8. pombredanne

   removed this from 00-AboutCodePlanneron Sep 5, 2025
9. pombredanne

   removed a parent issue on Sep 5, 2025

   • purl-next: Create decentralized, distributed PURL metadata collection #655
10. TG1999 commented on Sep 11, 2025

    

    TG1999

    on Sep 11, 2025

    Last edited by pombredanne

    Contributor

    More actions

    Related:

    • Add support for CPAN Distribution mining #694
11. pombredanne

    added this to 00-AboutCodePlanneron Sep 19, 2025
12. pombredanne

    added a parent issue on Sep 29, 2025

    • purl-next: Create decentralized, distributed PURL metadata collection #655
13. pombredanne

    changed the title [-]Collect PURLs for CPAN Perl packages[/-] [+]purl-next: Collect PURLs for CPAN Perl packages[/+] on Sep 29, 2025
14. AyanSinhaMahapatra

    self-assigned this

    on Sep 29, 2025
15. AyanSinhaMahapatra

    added 5 commits that reference this issue on Sep 30, 2025

    Add support for mining cpan packageURLs

    ...

    bffee60

    Add support for mining cpan packageURLs

    ...

    07c08cd

    Add support for mining cpan packageURLs

    ...

    8783ec5

    Add support for mining cpan packageURLs

    ...

    afd274c

    Add support for mining cpan packageURLs

    ...

    227d972
16. AyanSinhaMahapatra

    moved this to Review ready in 00-AboutCodePlanneron Sep 30, 2025
17. AyanSinhaMahapatra commented on Oct 1, 2025

    

    AyanSinhaMahapatra

    on Oct 1, 2025

    Member

    More actions

    We are now mining cpan packageURLs with:

    • getting all package names and index page details from https://www.cpan.org/modules/02packages.details.txt.gz
    • getting package versions from scraping individual author pages

    Pull requests to add this functionality:

    • Add support for mining cpan packageURLs #731

    This is now released at: https://pypi.org/project/minecode-pipelines/0.0.1b16/

    We also have this running in the CI using scancode-action:

    • github action file: https://github.com/aboutcode-data/minecode-pipelines-config/blob/main/.github/workflows/mine-cpan-packageurls.yml
    • github action run: https://github.com/aboutcode-data/minecode-pipelines-config/actions/runs/18145984162

    repos with data from npm packageURLs mined:

    • npm packageURL data: https://github.com/aboutcode-data/minecode-data-cpan-test
18. AyanSinhaMahapatra

    closed this as completedon Oct 3, 2025
19. github-project-automation

    moved this from Review ready to Done in 00-AboutCodePlanneron Oct 3, 2025
20. pombredanne commented on Oct 5, 2025

    

    pombredanne

    on Oct 5, 2025

    MemberAuthor

    More actions

    Thanks!
21. pombredanne

    moved this from Done to In validation in 00-AboutCodePlanneron Oct 5, 2025
22. pombredanne

    moved this from In validation to Validated in 00-AboutCodePlanneron Oct 6, 2025