Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AttributeError: 'NoneType' object has no attribute 'stream_id' #134

Open
neomi-tenenbaum-huawei opened this issue Mar 26, 2024 · 0 comments

Comments

@neomi-tenenbaum-huawei
Copy link

neomi-tenenbaum-huawei commented Mar 26, 2024

on file general/hooks/forward.py on FlexPrepare init (~line 64)

self.use_streams = torch.cuda.is_available() and policy.overlap
self.streams = {}
self.streams["prev_layer"] = torch.cuda.Stream() if self.use_streams else None
self.streams["next_layer"] = torch.cuda.Stream() if self.use_streams else None
self.streams["prev_batch"] = torch.cuda.Stream() if self.use_streams else None
self.streams["next_batch"] = torch.cuda.Stream() if self.use_streams else None
self.stream_names = list(self.streams.keys())

    for name, stream in self.streams.items():
            logger.info(f"{name}: id-{stream.stream_id}")

if 'stream' is None (self.use_streams is False), I will get the error: AttributeError: 'NoneType' object has no attribute 'stream_id'

you have to change the code to:
for name, stream in self.streams.items():
if stream:
logger.info(f"{name}: id-{stream.stream_id}")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant