IDA
IDA-PTW EEWS Review Tinjauan IDA-PTW EEWS 02 · Manuscript Audit 02 · Audit Manuskrip

Manuscript Audit Report

Laporan Audit Manuskrip

Every numeric claim in manuscript_draft_IEEE.md cross-referenced against the authoritative CSVs — with severity-graded issue list and priority fix ordering.

Setiap klaim numerik di manuscript_draft_IEEE.md di-cross-check terhadap CSV otoritatif — dengan daftar isu berperingkat tingkat keparahan dan urutan prioritas perbaikan.

ManuscriptManuskrip 764 lines · 89 refs 764 baris · 89 referensi Last editSuntingan terakhir 2026-04-19 Audit dateTanggal audit 2026-04-22

Issue Summary

Ringkasan Isu

SeverityTingkat CountJumlah CategoryKategori
Blocker4Number cannot be defended from data (missing CSV or fabricated label)Angka tidak bisa dipertahankan dari data (CSV hilang atau label palsu)
Major3Number disagrees with authoritative CSV (internal inconsistency)Angka tidak cocok dengan CSV otoritatif (inkonsistensi internal)
Minor5Rounding or label issue (fixable by 1-word edit)Isu rounding atau label (bisa diperbaiki dengan 1 kata)
OK15Matches CSV (already verified)Cocok CSV (sudah terverifikasi)

🔴 Blocker Issues

🔴 Isu Blocker

B1 Table 11 "Fixed 4" and "Fixed 6" rows — fabricated labelsTable 11 baris "Fixed 4" dan "Fixed 6" — label palsu

Location:Lokasi: Section V.A, Table 11, lines 378–389. Bagian V.A, Tabel 11, baris 378–389.

💡
Recommended fix: Perbaikan yang disarankan:
  • Change row "Fixed | 4" → "Fixed | 5" (values are correct for 5 s).
  • Ubah baris "Fixed | 4" → "Fixed | 5" (nilainya sudah benar untuk 5 s).
  • Delete row "Fixed | 6" entirely, OR regenerate actual 4 s and 6 s runs.
  • Hapus baris "Fixed | 6" seluruhnya, ATAU regenerasi run 4 s dan 6 s yang sebenarnya.

B2 Table 11 "IDA-PTW Operational" row — no CSV sourceTable 11 baris "IDA-PTW Operational" — tanpa sumber CSV

Claimed values: 0.6464 / 0.6252 / 0.6746 / 0.7531 / composite 0.7309. These numbers appear only in the manuscript; no CSV in reports/ contains them.

Nilai yang diklaim: 0,6464 / 0,6252 / 0,6746 / 0,7531 / komposit 0,7309. Angka-angka ini hanya muncul di manuskrip; tidak ada CSV di reports/ yang memuatnya.

B3 Table 12 Post-P Full-Wave & Total MiniSEED — no CSV artifactTable 12 Post-P Full-Wave & Total MiniSEED — tanpa artefak CSV

Post-P Full-Wave Avg R² = 0.947, Total MiniSEED = 0.957. These values are quoted in validation_evidence_report.md as coming from "run c7a50193" and "run c3399cac" respectively — but no CSV files for these runs exist in reports/. Only the scalar numbers are cited.

Post-P Full-Wave Avg R² = 0,947, Total MiniSEED = 0,957. Nilai ini dikutip di validation_evidence_report.md sebagai hasil "run c7a50193" dan "run c3399cac" — namun tidak ada file CSV untuk run tersebut di reports/. Hanya angka skalar yang dikutip.

B4 Abstract + Conclusion "composite R² = 0.731"Abstract + Kesimpulan "composite R² = 0,731"

Abstract and Table 17 quote "operational composite R² = 0.731" — this matches Table 11's "IDA-PTW Operational" composite 0.7309, which has no CSV provenance (see B2). Meanwhile validation_evidence_report.md quotes IDA-PTW Avg R² = 0.832 — a 10 p.p. difference.

Abstract dan Table 17 mengutip "operational composite R² = 0,731" — cocok dengan komposit "IDA-PTW Operational" 0,7309 di Table 11 yang tidak memiliki provenance CSV (lihat B2). Sementara itu validation_evidence_report.md mengutip IDA-PTW Avg R² = 0,832 — selisih 10 p.p.

🟠 Major Issues

🟠 Isu Major

M1 Abstract N consistencyKonsistensi N di Abstract

Claim is consistent throughout ("25,058 traces from 336 events") — but intensity_correlation_metrics.csv sums to 28,266 traces across 4 intensity bins. If this file underpins any per-intensity R² in the paper, the N is inflated.

Klaim konsisten di seluruh manuskrip ("25.058 trace dari 336 event") — namun intensity_correlation_metrics.csv berjumlah total 28.266 trace di 4 bin intensitas. Jika file ini menjadi dasar R² per-intensitas mana pun, N tersebut menggelembung.

M2 Stage 1 "Damaging Recall = 91.09%" — no CSV confirmationStage 1 "Damaging Recall = 91,09%" — tanpa konfirmasi CSV

91.09% recall is stated multiple times but no Stage 1 confusion matrix or classifier metrics CSV is found in reports/.

Recall 91,09% disebut beberapa kali namun tidak ditemukan matriks konfusi Stage 1 atau CSV metrik classifier di reports/.

M3 Sigma decomposition Table 15 — no CSV sourceDekomposisi Sigma Table 15 — tanpa sumber CSV

All τ, φ, σ_total values per period (0.324, 0.619, 0.698, etc.) are in the manuscript but no sigma CSV is found. This is the core Al Atik et al. [44] result.

Semua nilai τ, φ, σ_total per-periode (0,324, 0,619, 0,698, dll) ada di manuskrip namun tidak ada CSV sigma. Ini adalah hasil inti framework Al Atik et al. [44].

🟡 Minor Issues

🟡 Isu Minor

🟢 Verified OK

🟢 Terverifikasi OK

The manuscript is strongly supported by data for Evidence C (Saturation), Evidence D (P-arrival sensitivity), and the Fixed PTW benchmark — these tables (13, 14, and parts of 11) exactly match their authoritative CSVs. These sections can be submitted as-is.

Manuskrip didukung kuat oleh data untuk Evidence C (Saturation), Evidence D (P-arrival sensitivity), dan benchmark Fixed PTW — tabel-tabel ini (13, 14, dan sebagian 11) persis cocok dengan CSV otoritatifnya. Seksi-seksi ini bisa dikirim apa adanya.

Manuscript claimKlaim manuskripCSV sourceSumber CSV
Fixed 2/3/5/8/10 s × 3 periodsFixed 2/3/5/8/10 s × 3 periodebenchmark_results_fixed.csv
Saturation test @ 3 periods × 2 PTWUji saturasi @ 3 periode × 2 PTWsaturation_test_results.csv
P-arrival 7 shift values × 3 periodsP-arrival 7 nilai shift × 3 periodep_arrival_sensitivity.csv
N = 1,204 saturation subsetN = 1.204 subset saturasisaturation_test_results.csv
103 spectral periods T=0.051–10.0 s103 periode spektral T=0,051–10,0 sdataset metadatametadata dataset

The manuscript's structural logic and reference list are excellent (89 references, IEEE-complete, including the key Minson, Meier, Cremen & Galasso, Dai et al. citations). No citation issues found.

Logika struktural dan daftar referensi manuskrip sangat baik (89 referensi, lengkap untuk format IEEE, termasuk sitasi kunci Minson, Meier, Cremen & Galasso, Dai et al.). Tidak ada isu sitasi.

Priority Fix List for Publication-Readiness

Daftar Prioritas Perbaikan untuk Kesiapan Publikasi

  1. [BLOCKER] Resolve Table 11 "Fixed 4/6" labels — either rename or regenerate.
  2. [BLOCKER] Selesaikan label "Fixed 4/6" pada Table 11 — rename atau regenerasi.
  3. [BLOCKER] Produce CSV artifact for IDA-PTW end-to-end operational metrics (composite 0.7309 and per-period values).
  4. [BLOCKER] Buat artefak CSV untuk metrik end-to-end operational IDA-PTW (komposit 0,7309 dan nilai per-periode).
  5. [BLOCKER] Re-run or document the Full-Wave 341 s and Total MiniSEED 430 s experiments with CSV output.
  6. [BLOCKER] Re-run atau dokumentasikan eksperimen Full-Wave 341 s dan Total MiniSEED 430 s dengan output CSV.
  7. [MAJOR] Save Stage 0 URPD classifier metrics CSV (AUC, FAR, Recall at 3 operating points).
  8. [MAJOR] Simpan CSV metrik classifier Stage 0 URPD (AUC, FAR, Recall pada 3 operating point).
  9. [MAJOR] Save Stage 1 classifier metrics CSV (confusion matrix, per-class P/R/F1).
  10. [MAJOR] Simpan CSV metrik classifier Stage 1 (matriks konfusi, P/R/F1 per-kelas).
  11. [MAJOR] Save sigma decomposition CSV (Table 15 τ/φ/σ per period).
  12. [MAJOR] Simpan CSV dekomposisi sigma (Table 15: τ/φ/σ per-periode).
  13. [MAJOR] Reconcile intensity class distribution N (30,540 + 1,931 + 101 ≠ 25,058).
  14. [MAJOR] Rekonsiliasi N distribusi kelas intensitas (30.540 + 1.931 + 101 ≠ 25.058).
  15. [MAJOR] Reconcile Table 9 PTW distribution N (38,505 ≠ 25,058).
  16. [MAJOR] Rekonsiliasi N distribusi PTW Table 9 (38.505 ≠ 25.058).
  17. [MINOR] Resolve "end-to-end vs Stage-2-oracle" semantic consistently throughout the paper.
  18. [MINOR] Selesaikan ambiguitas semantik "end-to-end vs Stage-2-oracle" secara konsisten di seluruh paper.
  19. [MINOR] Add a PROVENANCE.md mapping every number in every table to its producing CSV.
  20. [MINOR] Tambahkan PROVENANCE.md yang memetakan setiap angka di setiap tabel ke CSV produsennya.

Audit performed 2026-04-22 · Manuscript state 2026-04-19 · CSV state 2026-04-19.Audit dilakukan 22-04-2026 · Status manuskrip 19-04-2026 · Status CSV 19-04-2026.