feat: data parallel inference examples

[bowang007]

Description

This PR shows a simple example about using accelerate library for data parallel inference.

Checklist:

• My code follows the style guidelines of this project (You can use the linters)
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas and hacks
• I have made corresponding changes to the documentation
• I have added tests to verify my fix or my feature
• New and existing unit tests pass locally with my changes
• I have added the relevant labels to my PR in so that relevant reviewers are notified

[github-actions]

There are some changes that do not conform to Python style guidelines:

--- /home/runner/work/TensorRT/TensorRT/examples/distributed_inference/data_parallel_gpt2.py 2024-05-02 00:29:27.054073+00:00+++ /home/runner/work/TensorRT/TensorRT/examples/distributed_inference/data_parallel_gpt2.py 2024-05-02 00:31:18.785078+00:00@@ -13,12 +13,26 @@ distributed_state = PartialState() model = GPT2LMHeadModel.from_pretrained("gpt2").eval().to(distributed_state.device) -model.forward = torch.compile(model.forward, backend="torch_tensorrt", options={"truncate_long_and_double": True, "enabled_precisions":{torch.float16}, "debug": True}, dynamic=False,)+model.forward = torch.compile(+ model.forward,+ backend="torch_tensorrt",+ options={+ "truncate_long_and_double": True,+ "enabled_precisions":{torch.float16},+ "debug": True,+ },+ dynamic=False,+) with distributed_state.split_between_processes([input_id1, input_id2]) as prompt: cur_input = torch.clone(prompt[0]).to(distributed_state.device) - gen_tokens = model.generate(cur_input, do_sample=True, temperature=0.9, max_length=100,)+ gen_tokens = model.generate(+ cur_input,+ do_sample=True,+ temperature=0.9,+ max_length=100,+ ) gen_text = tokenizer.batch_decode(gen_tokens)[0]

[narendasan]

1. Need a requirements.txt
2. Annotate the script with description of whats happening https://github.com/pytorch/TensorRT/blob/main/examples/dynamo/torch_compile_advanced_usage.py
3. Add a reference to index.rst so that it gets rendered in the docs:

   TensorRT/docsrc/index.rst

   Line 113 in 12e885a

   tutorials/_rendered_examples/dynamo/torch_compile_stable_diffusion

[narendasan]

LGTM

[HolyWu]

@bowang007 You didn't properly clean up the merge conflicts, therefore db24b3b had <<<<<<< HEAD, ======= and >>>>>>> dfbf6ea84 (feat: data parallel inference sample) remaining in docsrc/index.rst.