Skip to content

Why is there no bias in collapsed wt_tensor? #14

Open
@s1ddok

Description

@s1ddok

Hello! Thanks for your incredible work.

I'm closely following your code and I see one weird thing. So you initialize your Conv2D using tf.keras.layers.Conv2D which according to docs has trainable bias by default. But then when you collapse the block you call the conv2d func without bias and you don't even calculate it:

out = tf.nn.conv2d(inputs, wt_tensor, strides=[1, 1, 1, 1], padding="SAME")

can you explain is it a bug or bias gets cancelled somehow during collapsing?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions