Ian Lake from google replied me that we can store the view in a variable and instead of inflating a new layout, just return the instance of pre-stored view on onCreateView()
Source: https://twitter.com/ianhlake/status/1103522856535638016
Leakcanary may show this as leak but its false positive..