Skip to content

test(lmbench): 引入 lmbench 测试框架集成和自动测试脚本 - #1433

Open
mistcoversmyeyes wants to merge 22 commits into
DragonOS-Community:masterfrom
mistcoversmyeyes:feat/lmbench
Open

test(lmbench): 引入 lmbench 测试框架集成和自动测试脚本#1433
mistcoversmyeyes wants to merge 22 commits into
DragonOS-Community:masterfrom
mistcoversmyeyes:feat/lmbench

Conversation

@mistcoversmyeyes

@mistcoversmyeyes mistcoversmyeyes commented Dec 3, 2025

Copy link
Copy Markdown
Collaborator

No description provided.

@github-actions github-actions Bot added the test Unitest/User space test label Dec 3, 2025
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 6 times, most recently from 4ca963e to b5138f4 Compare December 17, 2025 15:46
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 4 times, most recently from 2edfdee to cc88ddc Compare December 18, 2025 17:32
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 2 times, most recently from 5657c94 to a05fcb8 Compare January 13, 2026 11:13
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 2 times, most recently from 8ef1628 to a9a963e Compare July 30, 2026 04:24
@mistcoversmyeyes
mistcoversmyeyes marked this pull request as ready for review July 31, 2026 11:05
@mistcoversmyeyes mistcoversmyeyes mentioned this pull request Aug 1, 2026
Closed
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 2 times, most recently from 1f409e9 to 364364f Compare August 12, 2026 14:41
sparkzky
sparkzky reviewed Aug 13, 2026
View reviewed changes
Comment thread .worktrees/feat-lmbench Outdated
@sparkzky

sparkzky commented Aug 13, 2026

Copy link
Copy Markdown
Member

几个 commit 里提到的数字不太一样（8/8、31/47、32/23），想确认下以最新代码为准，现在是多少 ok / 总共多少个？有没有逐个测例的通过清单？
以及对于 failed 的那些，大概哪些是 DragonOS 内核还没实现的特性导致的，哪些是测例脚本本身的问题？

mistcoversmyeyes
mistcoversmyeyes commented Aug 13, 2026
View reviewed changes

@mistcoversmyeyes mistcoversmyeyes left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's this

Something to be clean

mistcoversmyeyes
mistcoversmyeyes commented Aug 13, 2026
View reviewed changes

@mistcoversmyeyes mistcoversmyeyes left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

几个 commit 里提到的数字不太一样（8/8、31/47、32/23），想确认下以最新代码为准，现在是多少 ok / 总共多少个？
由于 Full Run 的时候，中间部分测试用例会随机卡住，阻塞后续用例运行，故而每次 Full Run OK 的测试用例数目都不一样，但是大概是 31/47 这样。

@mistcoversmyeyes mistcoversmyeyes mentioned this pull request Sep 18, 2026
Open
2 tasks
@mistcoversmyeyes mistcoversmyeyes self-assigned this Sep 21, 2026
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 2 times, most recently from f2a9f17 to 32e2f5a Compare September 21, 2026 16:37
@mistcoversmyeyes mistcoversmyeyes mentioned this pull request Sep 24, 2026
Open
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 3 times, most recently from 9473631 to 7f53deb Compare September 27, 2026 05:57
mistcoversmyeyes and others added 14 commits October 3, 2026 00:16
@mistcoversmyeyes
docs(harness): establish project guidance and ignore local worktrees
6539ed3 
Establish project guidance and worktree ignore rules.
@mistcoversmyeyes
docs(lmbench): define runner architecture and full-suite implementati…
6b25072 
…on plans

Introduce runner abstraction and metadata extraction designs and plans before implementation.
@mistcoversmyeyes @Samuka007 @sparkzky
feat(lmbench): add portable full-suite runner and regression tests
0bba884 
Add the full suite, portable runners, regression tests and metadata survey.
Document runner arguments, Linux execution, case authoring and calibration alongside the implementation.

Co-authored-by: Samuka007 <samuka007@dragonos.org>
Co-authored-by: sparkzky <sparkhhhhhhhhhh@outlook.com>
@mistcoversmyeyes @Samuka007
build(lmbench): package benchmark binaries and guest scripts
4826b83 
Package the benchmark binaries and guest scripts through Nix and DADK.

Co-authored-by: Samuka007 <samuka007@dragonos.org>
@mistcoversmyeyes
feat(lmbench): integrate qemu execution and result collection
a11945a 
Add QEMU execution, monitoring, result collection and schema validation.
Extend the suite README with the end-to-end workflow, guest prerequisites, architecture and result schema.
@mistcoversmyeyes
ci(lmbench): add benchmark workflow
0acb0d9 
Run the benchmark workflow and publish result artifacts.
@mistcoversmyeyes
docs(lmbench): record recovery validation and remaining limitations
c06385e 
Record wrapper and guest recovery validation, scope boundaries and remaining failures.
@mistcoversmyeyes
fix(dadk/ubuntu2404): append lmbench install config for ubuntu2404 ro…
573bcfa 
…otfs
@mistcoversmyeyes
fix(lmbench): restore terminal output newline handling
6108fc7
@mistcoversmyeyes
chore(gvisor): 启用 alarm_test 测试集
edebb08
@mistcoversmyeyes
feat(app-blocklist): enable lmbench app installation
3413080
@mistcoversmyeyes
fix(init): include system administration directories in path
9eb6169 
Add /usr/sbin and /sbin to the PATH exported by rcS so startup tasks and
benchmark preparation can resolve tools such as mkfs.ext4.
@mistcoversmyeyes
docs(harness): authorize atomic commits in agent workflow
8eddcaf
@mistcoversmyeyes
docs(harness): simplify workflow map description
4abd26a
@mistcoversmyeyes
test(lmbench): exclude observed guest runtime blockers
b38f940 
Comment out eight cases that panicked or returned invalid measurements during sequential DragonOS runs. Record the observed failure and guest configuration beside each exclusion.

Validated the working-tree whitelist: 39/39 successful, no failures or skips, with 512 MiB, 2 vCPUs, one sample and a 120-second timeout. The pre-existing fifo_lat exclusion and sample-count override remain unstaged.
@mistcoversmyeyes
chore(lmbench/whitelist): 屏蔽 block 的测试用例
19d2ce4
@mistcoversmyeyes
chore(config/app-blocklist): 将 lmbench app 移除 DADK 全局安装黑名单
dd54d71
@mistcoversmyeyes
chore(/): 添加测试目录软链接
b069390
@mistcoversmyeyes
fix(qemu): align nix guest memory with 2g default
685c8d6
@mistcoversmyeyes
fix(lmbench): use temporary disk writes for benchmark runs
35e2324
@mistcoversmyeyes
docs(lmbench): move harness plans into benchmark directory
005ead6
@mistcoversmyeyes
mistcoversmyeyes force-pushed the feat/lmbench branch 2 times, most recently from dec9ee0 to fcf72db Compare October 5, 2026 17:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sparkzky sparkzky sparkzky left review comments

Assignees

@mistcoversmyeyes mistcoversmyeyes

Labels

test Unitest/User space test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mistcoversmyeyes @sparkzky