meddlr.modeling.blocks.SimpleConvBlockNd#
- class meddlr.modeling.blocks.SimpleConvBlockNd(in_channels: int, out_channels: int, kernel_size: Union[int, Tuple[int, ...]], dimension: int, stride: Union[int, Tuple[int, ...]] = 1, dropout: float = 0.0, padding: Union[str, int, Tuple[int, ...]] = 'same', order: Sequence[Union[str, Dict[str, Union[Dict[str, Any], List[Any], Tuple[Any], List[Tuple[str, Any]], Tuple[Tuple[str, Any], ...]]], Tuple[str, Union[Dict[str, Any], List[Any], Tuple[Any], List[Tuple[str, Any]], Tuple[Tuple[str, Any], ...]]], LayerInfo]] = ('conv', 'batchnorm', 'relu', 'dropout'))[source]#
A convolutional block supporting normalization, conv, activation, and dropout.
The first conv layer will change the number of channels from
in_channelstoout_channels.- The order of layers can be specified by certain keywords:
“conv”: Convolution layer
“convws”: Convolution + Weight Standardization layer
“batchnorm”/”bn”: Batch Normalization
“instancenorm”: Instance Normalization
“groupnorm”: Group Normalization
“relu”: ReLU
“dropout”: Dropout
- Parameters
in_channels – Number of channels in the input.
out_channels – Number of channels in the output.
kernel_size – Convolution kernel size.
dimension – Integer specifying the dimension of convolution.
dropout – Dropout probability.
order – Order of layers in the convolution block.
- __init__(in_channels: int, out_channels: int, kernel_size: Union[int, Tuple[int, ...]], dimension: int, stride: Union[int, Tuple[int, ...]] = 1, dropout: float = 0.0, padding: Union[str, int, Tuple[int, ...]] = 'same', order: Sequence[Union[str, Dict[str, Union[Dict[str, Any], List[Any], Tuple[Any], List[Tuple[str, Any]], Tuple[Tuple[str, Any], ...]]], Tuple[str, Union[Dict[str, Any], List[Any], Tuple[Any], List[Tuple[str, Any]], Tuple[Tuple[str, Any], ...]]], LayerInfo]] = ('conv', 'batchnorm', 'relu', 'dropout'))[source]#
Initializes internal Module state, shared by both nn.Module and ScriptModule.
Methods
__init__(in_channels, out_channels, ...[, ...])Initializes internal Module state, shared by both nn.Module and ScriptModule.
add_module(name, module)Adds a child module to the current module.
append(module)Appends a given module to the end.
apply(fn)Applies
fnrecursively to every submodule (as returned by.children()) as well as self.bfloat16()Casts all floating point parameters and buffers to
bfloat16datatype.buffers([recurse])Returns an iterator over module buffers.
children()Returns an iterator over immediate children modules.
cpu()Moves all model parameters and buffers to the CPU.
cuda([device])Moves all model parameters and buffers to the GPU.
double()Casts all floating point parameters and buffers to
doubledatatype.eval()Sets the module in evaluation mode.
extend(sequential)extra_repr()Set the extra representation of the module
float()Casts all floating point parameters and buffers to
floatdatatype.forward(input)Defines the computation performed at every call.
get_buffer(target)Returns the buffer given by
targetif it exists, otherwise throws an error.get_extra_state()Returns any extra state to include in the module's state_dict.
get_parameter(target)Returns the parameter given by
targetif it exists, otherwise throws an error.get_submodule(target)Returns the submodule given by
targetif it exists, otherwise throws an error.half()Casts all floating point parameters and buffers to
halfdatatype.insert(index, module)ipu([device])Moves all model parameters and buffers to the IPU.
load_state_dict(state_dict[, strict])Copies parameters and buffers from
state_dictinto this module and its descendants.modules()Returns an iterator over all modules in the network.
named_buffers([prefix, recurse, ...])Returns an iterator over module buffers, yielding both the name of the buffer as well as the buffer itself.
named_children()Returns an iterator over immediate children modules, yielding both the name of the module as well as the module itself.
named_modules([memo, prefix, remove_duplicate])Returns an iterator over all modules in the network, yielding both the name of the module as well as the module itself.
named_parameters([prefix, recurse, ...])Returns an iterator over module parameters, yielding both the name of the parameter as well as the parameter itself.
parameters([recurse])Returns an iterator over module parameters.
pop(key)register_backward_hook(hook)Registers a backward hook on the module.
register_buffer(name, tensor[, persistent])Adds a buffer to the module.
register_forward_hook(hook, *[, prepend, ...])Registers a forward hook on the module.
register_forward_pre_hook(hook, *[, ...])Registers a forward pre-hook on the module.
register_full_backward_hook(hook[, prepend])Registers a backward hook on the module.
register_full_backward_pre_hook(hook[, prepend])Registers a backward pre-hook on the module.
register_load_state_dict_post_hook(hook)Registers a post hook to be run after module's
load_state_dictis called.register_module(name, module)Alias for
add_module().register_parameter(name, param)Adds a parameter to the module.
register_state_dict_pre_hook(hook)These hooks will be called with arguments:
self,prefix, andkeep_varsbefore callingstate_dictonself.requires_grad_([requires_grad])Change if autograd should record operations on parameters in this module.
set_extra_state(state)This function is called from
load_state_dict()to handle any extra state found within the state_dict.share_memory()See
torch.Tensor.share_memory_()state_dict(*args[, destination, prefix, ...])Returns a dictionary containing references to the whole state of the module.
to(*args, **kwargs)Moves and/or casts the parameters and buffers.
to_empty(*, device)Moves the parameters and buffers to the specified device without copying storage.
train([mode])Sets the module in training mode.
type(dst_type)Casts all parameters and buffers to
dst_type.xpu([device])Moves all model parameters and buffers to the XPU.
zero_grad([set_to_none])Sets gradients of all model parameters to zero.
Attributes
T_destinationalias of TypeVar('T_destination', bound=
Dict[str,Any])call_super_initdump_patches