Skip to content

Doc update and added SFT integ test#6018

Merged
zhaoqizqwang merged 6 commits into
aws:masterfrom
zhaoqizqwang:doc-fix
Jul 17, 2026
Merged

Doc update and added SFT integ test#6018
zhaoqizqwang merged 6 commits into
aws:masterfrom
zhaoqizqwang:doc-fix

Conversation

@zhaoqizqwang

@zhaoqizqwang zhaoqizqwang commented Jul 13, 2026

Copy link
Copy Markdown
Collaborator
  • Moved Nova-only CPT notebook from open-weight section to Nova section.
  • Renamed "Customizing Models" section name → "Model Customization (Foundation Models)".
  • Consolidated deployment docs: moved "Model Deployment" subpage under Model customization to "Deploy Models for Inference" (including Bedrock).
  • Added SFT SMTJ serverful integ test

- Moved Nova-only CPT notebook from open-weight section to Nova section.
- Renamed "Customizing Models" → "Model Customization (Foundation Models)".
- Consolidated deployment docs under "Deploy Models for Inference" (including Bedrock).
- Added SFT SMTJ serverful integ test
unique_id = f"{int(time.time())}-{random.randint(1000, 9999)}"

sft_trainer = SFTTrainer(
model="amazon.nova-2-lite-v1",

@mujtaba1747 mujtaba1747 Jul 16, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we use nova micro for SFT serverful instead. It may support chepaer g5/g6 instances? Getting P5 capacity is difficult and using p5 might make it hard for this test to be picked up.

How long did it take for the test to get picked up when you tried it out manually?

@mujtaba1747 mujtaba1747 Jul 16, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can use P5 for RLVR instead. As I don't think there are recipes for g5/g6 for rlvr.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes updated to micro model. Uses g6 instance instead

{"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is machine learning?"}]}, {"role": "assistant", "content": [{"text": "Machine learning is a subset of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed."}]}]}
{"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "Explain what AWS is."}]}, {"role": "assistant", "content": [{"text": "AWS (Amazon Web Services) is a comprehensive cloud computing platform that provides on-demand computing resources and services."}]}]}
{"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is Python used for?"}]}, {"role": "assistant", "content": [{"text": "Python is a versatile programming language used for web development, data analysis, artificial intelligence, scientific computing, and automation."}]}]}
{"schemaVersion": "nova-sft-2025-01-01", "messages": [{"role": "user", "content": [{"text": "What is machine learning?"}]}, {"role": "assistant", "content": [{"text": "Machine learning is a subset of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed."}]}]}

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, this makes the test easy to port across accounts.

@@ -0,0 +1,172 @@
# Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We also need test for OSS + Serverful. But that will be a different PR.

@zhaoqizqwang
zhaoqizqwang deployed to auto-approve July 17, 2026 06:38 — with GitHub Actions Active
@zhaoqizqwang
zhaoqizqwang merged commit 041f6b5 into aws:master Jul 17, 2026
8 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants