vuw_course_scraper, branch v0.2.0A scraper that can parse all of Victoria University of Wellington's courses, and output them in a computer-readable JSON file.
http://git.sophieforrest.com/vuw_course_scraper/atom?h=v0.2.02024-12-04T07:48:31+00:00feat(cli): use clap for a command line interface2024-12-04T07:48:31+00:00Sophie Forrestgit@sophieforrest.com2024-12-04T07:48:31+00:00urn:sha1:3bd5ebb7b8f938ba57a114cd77c0b5c5ad3bf93e
Allows choosing the year and file path.
feat(parser): finish nom rewrite with coursepoints parser2024-12-04T04:53:46+00:00Sophie Forrestgit@sophieforrest.com2024-12-04T04:53:46+00:00urn:sha1:3725fe07e58f459bb7ab9fcbc10775cf4b138ec8
This parser can correctly parse course prerequisites, corequisites, and
restrictions, which the previous parser could not do. These cannot be
split into a truly computer readable format yet, and I believe this
would be out of scope for this project.
feat: use 2025 index2024-11-10T02:54:32+00:00Sophie Forrestgit@sophieforrest.com2024-11-10T02:54:32+00:00urn:sha1:f20503aa26ec2e91fb585defa338993985dac2e5feat: move from openssl to rustls2024-11-10T02:53:23+00:00Sophie Forrestgit@sophieforrest.com2024-11-10T02:53:23+00:00urn:sha1:2d6245e05d6f153d911ce5763c3d8ac7d42b3171
This removes external dependencies on pkg-config and openssl, only
requiring the rustls dependency, meaning the entire program is in Rust,
simplifying the build system on all platforms.
chore: update flake.lock2024-10-19T07:45:33+00:00Sophie Forrestgit@sophieforrest.com2024-10-19T07:45:33+00:00urn:sha1:76eb2064952b548a3e171cb41c69939640a1d657feat: add corequisites field2024-10-09T01:30:10+00:00Sophie Forrestgit@sophieforrest.com2024-10-09T01:30:10+00:00urn:sha1:3d00decabe8ab6c4fc55d57182688cec0fa2509f
This currently stores no information as no parser exists for it. I will
accept contributions for this, as it will likely take me a while to get
around to implementing.
The ideal goal we're aiming for would be to rewrite all the parsing
logic in nom. The only parser left is the "coursepoints" / requirements
parser. This parser has proven to be particularly difficult and
resistant to rewrites.
I expect this will take weeks, if not months to get around to. But, as
mentioned, contributions are very welcome.
chore: ban exported files from git2024-10-09T01:26:21+00:00Sophie Forrestgit@sophieforrest.com2024-10-09T01:26:21+00:00urn:sha1:0e34785c05825806137d2cfff95db835905986d4chore: remove devenv2024-10-09T01:18:14+00:00Sophie Forrestgit@sophieforrest.com2024-10-09T01:18:14+00:00urn:sha1:394af13667ad2fb81f28eaac59f2e9bdbbe5e520
Uses a native nix shell.
chore(flake): improve nix infrastructure2024-10-08T23:35:49+00:00Sophie Forrestgit@sophieforrest.com2024-10-08T23:35:49+00:00urn:sha1:a434c31af9376c739837b2d1fadaf8c1b84c843efeat: use BTreeMap for alphabetical sorting2024-10-05T07:48:47+00:00Sophie Forrestgit@sophieforrest.com2024-10-05T07:48:47+00:00urn:sha1:9518e130263dd547eaee66b6cae846809ba2d160