Skip to content

Halyna R. - #7

Open
halyna1995 wants to merge 6 commits into
HackYourAssignment:mainfrom
halyna1995:week12/halyna
Open

Halyna R.#7
halyna1995 wants to merge 6 commits into
HackYourAssignment:mainfrom
halyna1995:week12/halyna

Conversation

@halyna1995

@halyna1995 halyna1995 commented Jul 23, 2026

Copy link
Copy Markdown

What I built

Student status note (preserved from prior PR description):

Completed:

  • monthly Airflow DAG
  • successful local manual run
  • dbt run and dbt test
  • initial backfill evidence
  • AI_ASSIST.md
  • RUNBOOK.md

Still in progress (per student):

  • final seven-month SQL verification
  • idempotency row-count comparison
  • ASSIGNMENT_REPORT.md
  • shared Airflow deployment proof, if available

How to review

  • DAG: read dags/taxi_pipeline.py (schedule, task order, catchup=False, retries, partition date).
  • Evidence: backfill / idempotency notes in ASSIGNMENT_REPORT.md; operations in RUNBOOK.md.
  • AI usage: AI_ASSIST.md.

How to run

From a clean clone, with the Astro CLI installed:

astro dev start
astro dev pytest tests/test_dag_integrity.py --args "-v"

Then open the UI URL, add the azure_pg connection (Admin → Connections), unpause taxi_pipeline, and trigger a run for a real month (e.g. 2024-01-01).

Prerequisite: your Week 10 dbt project in include/dbt_project/ and the azure_pg connection to the shared Postgres.

What reviewers should see (expected results)

Fill in what your run actually produces:

  • test_dag_integrity.py result: <e.g. all pass>
  • Task order in the Graph view: <e.g. ingest → dbt_run → dbt_test>
  • Backfill: <e.g. 7 runs green, re-run is idempotent (same row count)>
  • Deployed DAG name (Target tier): <e.g. taxi_pipeline_>

Known limitations / out of scope

  • Student noted work still in progress: final 7-month SQL verification, idempotency row-count comparison, ASSIGNMENT_REPORT.md, and shared Airflow deploy proof if available.

Self-check

  • bash .hyf/test.sh passes
  • astro dev pytest tests/test_dag_integrity.py passes
  • catchup=False and retries are set
  • No credentials committed (connections added in the UI, not in code)
  • Backfill / idempotency evidence is in ASSIGNMENT_REPORT.md

@lassebenni

Copy link
Copy Markdown
Contributor

Reopening to re-trigger grade workflow after checkout fix on main.

@lassebenni lassebenni closed this Jul 24, 2026
@lassebenni lassebenni reopened this Jul 24, 2026
Pick up ASSIGNMENT_REPORT TODO scoring, max_active_runs check, and
screenshot presence (≥3 image files).

Co-authored-by: Cursor <cursoragent@cursor.com>
@lassebenni

Copy link
Copy Markdown
Contributor

Autograder note (teacher)

The CI score is a static smoke test only (file presence + code patterns + docs/screenshot files). It does not grade:

  • whether screenshots show a real green Graph / Grid / task log / shared-UI run
  • before/after backfill row counts
  • shared-Airflow deploy proof (merged PR URL + tagged screenshot)

Autograder 100 ≠ assignment pass. Teachers review those from your PR against the Week 12 deliverables. Please make sure ASSIGNMENT_REPORT.md is fully filled (no TODOs), commit at least 3 screenshot images, and include shared-deploy evidence when the class VM is up.

@github-actions

This comment has been minimized.

@HackYourAssignment HackYourAssignment deleted a comment from github-actions Bot Jul 24, 2026
@github-actions

This comment has been minimized.

Missing <3 screenshot images now forces pass=false (blocker).

Co-authored-by: Cursor <cursoragent@cursor.com>
@github-actions

Copy link
Copy Markdown

📝 HackYourFuture auto grade

Assignment Score: 100 / 100 ✅

Status: ✅ Passed
Minimum score to pass: 60
🧪 The auto grade is experimental and still being improved

Test Details

=== Week 12 Autograder — Orchestrated Pipeline ===
  ✓ PASS  found dags/taxi_pipeline.py
  ✓ PASS  found tests/test_dag_integrity.py
  ✓ PASS  found requirements.txt
  ✓ PASS  found RUNBOOK.md
  ✓ PASS  found ASSIGNMENT_REPORT.md
  ✓ PASS  found AI_ASSIST.md
  ✓ PASS  Level 1: required files (20/20 pts)
  ✓ PASS  dags/taxi_pipeline.py: no NotImplementedError stubs left
  ✓ PASS  dags/taxi_pipeline.py: defines a @dag with tasks
  ✓ PASS  Level 2: DAG implemented (15/15 pts)
  ✓ PASS  dags/taxi_pipeline.py: ingest, dbt_run, and dbt_test all present
  ✓ PASS  dags/taxi_pipeline.py: tasks are chained with >>
  ✓ PASS  Level 3: sequential tasks (20/20 pts)
  ✓ PASS  dags/taxi_pipeline.py: dbt runs through uvx (works on the image's Python 3.14)
  ✓ PASS  dags/taxi_pipeline.py: retry behaviour configured (retries=...)
  ✓ PASS  Level 4: uvx dbt + retries (20/20 pts)
  ✓ PASS  dags/taxi_pipeline.py: partition derived from the logical date
  ✓ PASS  dags/taxi_pipeline.py: catchup=False and max_active_runs set
  ✓ PASS  Level 5: parameterized runs (15/15 pts)
  ✓ PASS  RUNBOOK.md: filled in (2905 chars, no TODO left)
  ✓ PASS  AI_ASSIST.md: filled in (1020 chars, no TODO left)
  ✓ PASS  ASSIGNMENT_REPORT.md: filled in (807 chars, no TODO left)
  ✓ PASS  screenshots: found 4 image file(s) (need ≥3 for Graph + Grid/run + task log)
  ✓ PASS  Level 6: documentation + screenshots (10/10 pts)

Score: 100 / 100  (passing: 60)  pass=true

Reminder: screenshot *content*, shared-Airflow deploy proof, and before/after
row counts are still teacher-reviewed. Autograder green is not a pass — a
high static score is necessary but not sufficient.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants