Update Prometheus monitoring docs for Training Operator

[andreyvelich]

As we discussed in this PR, we should update and move the Prometheus monitoring docs to the Kubeflow website: #2252.

cc @kubeflow/wg-training-leads

/good-first-issue
/area docs
/kind feature

[google-oss-prow]

@andreyvelich:
This request has been marked as suitable for new contributors.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue command.

In response to this:

As we discussed in this PR, we should update and move the Prometheus monitoring docs to the Kubeflow website: #2252.

cc @kubeflow/wg-training-leads

/good-first-issue
/area docs
/kind feature

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[sophie0730]

Hello,
I'm new to Kubeflow and interested in contributing to this issue. Before I begin, I have a few questions:

1. Will the documentation be contributed to the kubeflow/website repository? (Will the PR be created in the kubeflow/website repo?)
2. Should I draft a new version of the Prometheus monitoring doc, or can I directly move the document you provided to the website?
3. If I need to draft a new version of the Prometheus monitoring doc, could you please direct me to resources that will help me fully understand this effort?

Thank you for your guidance. I'm looking forward to contributing to the project. @andreyvelich

[tenzen-y]

As we discussed in this PR, we should update and move the Prometheus monitoring docs to the Kubeflow website: #2252.

+1

[tenzen-y]

Will the documentation be contributed to the kubeflow/website repository? (Will the PR be created in the kubeflow/website repo?)

Yes.

Should I draft a new version of the Prometheus monitoring doc, or can I directly move the document you provided to the website?

Reorganizing existing descriptions and making the metrics details more informable would be helpful.

[andreyvelich]

@tenzen-y is right, @sophie0730 feel free to submit draft PR in the kubeflow/website to add docs about Prometheus metrics.
/assign @sophie0730

[sophie0730]

Thanks @tenzen-y and @andreyvelich! I'll raise a PR as soon as possible.