Skip to content

Conversation

@mfeliz-cruise
Copy link
Contributor

Description

The TensorRT topk layer requires at least 2 dimensions in the input tensor. Previously you would see this error for 1D inputs: ERROR: [Torch-TensorRT TorchScript Conversion Context] - 3: (Unnamed Layer* 74) [TopK]: at least 2 dimensions are required for input.

This PR adds an unsqueeze for the inputs and corresponding squeeze for the outputs to workaround this limitation.

Fixes # (issue)

Type of change

Please delete options that are not relevant and/or add your own.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Checklist:

  • My code follows the style guidelines of this project (You can use the linters)
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas and hacks
  • I have made corresponding changes to the documentation
  • I have added tests to verify my fix or my feature
  • New and existing unit tests pass locally with my changes
  • I have added the relevant labels to my PR in so that relevant reviewers are notified

# Description The TensorRT topk layer requires at least 2 dimensions in the input tensor. Previously you would see this error for 1D inputs: `ERROR: [Torch-TensorRT TorchScript Conversion Context] - 3: (Unnamed Layer* 74) [TopK]: at least 2 dimensions are required for input.` This PR adds an unsqueeze for the inputs and corresponding squeeze for the outputs to workaround this limitation. Fixes # (issue) ## Type of change Please delete options that are not relevant and/or add your own. - Bug fix (non-breaking change which fixes an issue) - New feature (non-breaking change which adds functionality) - Breaking change (fix or feature that would cause existing functionality to not work as expected) - This change requires a documentation update # Checklist: - [ ] My code follows the style guidelines of this project (You can use the linters) - [ ] I have performed a self-review of my own code - [ ] I have commented my code, particularly in hard-to-understand areas and hacks - [ ] I have made corresponding changes to the documentation - [ ] I have added tests to verify my fix or my feature - [ ] New and existing unit tests pass locally with my changes - [ ] I have added the relevant labels to my PR in so that relevant reviewers are notified
@github-actionsgithub-actionsbot added component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: core Issues re: The core compiler component: tests Issues re: Tests labels Nov 30, 2022
Copy link
Collaborator

@peri044peri044 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@peri044peri044 merged commit 3decf45 into pytorch:masterDec 1, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signedcomponent: conversionIssues re: Conversion stagecomponent: convertersIssues re: Specific op converterscomponent: coreIssues re: The core compilercomponent: testsIssues re: Tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@mfeliz-cruise@peri044@facebook-github-bot