Repository navigation
Assessment protocol: four red-team follow-ups (reproducible scripts, one pr-audit, FUNDING fix) - #14
Open
zhaoxinghua09-cell wants to merge 4 commits into
Conversation
`.github/scripts/pr-audit.py` 与 `welcome-self-test.py` 在五个仓里存在两个版本:
619116C8(8209 B,lgd-gate / LGD-Eval / skill-audit)与 72B7B97E(6491 B,
evaluation-protocol / evaluation-evidence)。
不是风格差异,是能力差异:
- 旧版 T4 把 README/AGENTS/LICENSE/SECURITY 四个文件名写死在 os.path.exists(k),
检查的是**当前工作目录**,不是仓库。实测:从仓库父目录调用,
`SELF-TEST FAIL — T4 missing key files in checkout: ['README.md','AGENTS.md','LICENSE','SECURITY.md']`。
也就是说,调用点换个目录,这支 CI 守卫就把"文件都在"报成"全缺"。
- 旧版没有 _repo_root(),没有 --help,无 git 时的路径回退靠字符串裁剪,容易越界。
- 正典版把 T4 改成合成目录里的逻辑自测(验"缺失检测"这件事本身),
关键文件清单可用 PR_AUDIT_KEYFILES 按仓库覆盖。
处置:两仓整文件取正典版。复测:仓内 cwd 与父目录 cwd 双向 SELF-TEST PASS,
脚本哈希统一为 619116C8。
这是"同一件事两处实现"的第五次命中(等级/规则表/引擎副本/CLI 与库/CI 脚本)。
判断类脚本尤其不能分叉:它不报警的时候,没人会去怀疑它。
.github/FUNDING.yml 是 GitHub 唯一会读的资助配置位,只认键值(github / patreon / custom …)。 本仓那份是 871 B 的 markdown 说明(## 资助方式、- **GitHub Sponsors**), YAML 在 "> " 引用块处直接解析失败——资助按钮从来不会出现,而五个仓里只有 lgd-gate 是对的(16 B)。 处置:根目录说明改名 FUNDING.md(它本来就是 markdown);.github/FUNDING.yml 改为 github: LGD-Eval。 另按 dependabot 生态对齐:本仓有 package.json 却只开 github-actions,补 npm。 (skill-audit 同类问题:有 pyproject.toml 缺 pip。) 由 lgd-gate 的 tests/test_ci_config_shapes.py 跨仓守卫覆盖,markdown 塞回去即红。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Assessment protocol: four follow-ups from the red-team pass / 评估协议:红队走查后的四处收口
EN. This PR puts the four red-team follow-ups into
evaluation-protocolso the protocol repo stops being the one place with no reviewable entry point. It does not change any evaluator behaviour, does not touchLICENSE, and does not publish anything.8e8765areviews/cosai-ws4-issue158/attack_vectors.py— keep the attack vectors reproducible after the review round5b213a0reviews/verified-transition-loop/make_variants.py— same for the transition-loop review2ca0651pr-audit.pyran a stale copy when invoked outside the repo — two implementations of one job; now one071b5c5.github/FUNDING.ymlheld Markdown, so GitHub could not read the funding entryEN — how it was verified.
4commits,6 files changed, +147 −63. Every script above was run locally before committing; nothing here depends on machine-local state. No secrets, no customer data, no license text changes.中文。 本 PR 把红队走查后的四处收口放进
evaluation-protocol,让协议仓不再是"没有对外评审入口"的那一个。不改任何评测器行为、不动LICENSE、不发布任何东西。8e8765areviews/cosai-ws4-issue158/attack_vectors.py——让攻击向量在评审轮之后仍可复现5b213a0reviews/verified-transition-loop/make_variants.py——过渡环评审同理2ca0651pr-audit.py在仓外跑的是旧副本——同一件差事两个实现;现已合一071b5c5.github/FUNDING.yml里放的是 Markdown,GitHub 读不到资助入口中文——验证方式。 4 个提交、6 个文件、+147 −63。上面每个脚本提交前都在本机实跑过;不依赖任何本机残留配置。无密钥、无客户数据、不改许可证文本。
Reviewed-as: source-only change set. Merge is the maintainer's call, not the submitter's.