Take bus # 1 or # 4 to the end stop Lázně III, then continue roughly 100 metres across the river to Windsor Hotel.