You can disable a specific handle in a line, so it won't be movable:
MyLine.SourceHandle.Visible := False;