Skip to content

remove VmWorkJob after adding a nic to a vm - #5658

Merged
DaanHoogland merged 9 commits into
apache:4.16from
shapeblue:removeVmWorkJobAfterNicAdd
Jan 10, 2022
Merged

remove VmWorkJob after adding a nic to a vm#5658
DaanHoogland merged 9 commits into
apache:4.16from
shapeblue:removeVmWorkJobAfterNicAdd

Conversation

@DaanHoogland

@DaanHoogland DaanHoogland commented Nov 2, 2021

Copy link
Copy Markdown
Contributor

Description

This PR intents to

Fixes: #5541 without regressing #5651

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

manual tested

scenario 1: "Parallel adding of multiple networks"

create five shared networks,
create a VM in one of those
run a command line like

for net in \
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "759a94ac-3c36-425c-b3ef-94a2ada9f8a1"\
  "a7ce3c15-8497-4e52-9530-1a1ebf2cb023"\
  "8da9d26a-c139-49f0-ae64-fd38b331d48d"
do
    cmk add nictovirtualmachine networkid=$net virtualmachineid=c22686c7-1ff9-4e66-afe5-348127ef7fe2 &
done

substituting the right IDs

scenarion 2: "Parallel adding the same network multiple times"

create two shared networks,
create a VM in one of those
run a command line like

for net in \
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"
do
    cmk add nictovirtualmachine networkid=$net virtualmachineid=c22686c7-1ff9-4e66-afe5-348127ef7fe2 &
done

substituting the right IDs

scenario 3: "re-adding a network"

create two shared networks,
create a VM in one of those
add and remove the second one multiple times.

@DaanHoogland DaanHoogland added this to the 4.16.0.0 milestone Nov 2, 2021
@DaanHoogland

Copy link
Copy Markdown
Contributor Author

still needs testing @weizhouapache m but can you review?

@yadvr

yadvr commented Nov 3, 2021

Copy link
Copy Markdown
Member

PR doesn't seem ready cc @DaanHoogland @weizhouapache @nvazquez @sureshanaparti

@weizhouapache weizhouapache left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

verified the issue #5651 is fixed.

@yadvr yadvr left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding to Wei's LGTM

@DaanHoogland

Copy link
Copy Markdown
Contributor Author

note that travis job 14 is showing regressions. we can't merge this.
it assumes cone in #5541 which should be reverted to get 4.16 out.
cc @div8cn

@nvazquez nvazquez closed this Nov 4, 2021
@DaanHoogland DaanHoogland reopened this Nov 4, 2021
@yadvr
yadvr changed the base branch from main to 4.16 November 15, 2021 10:15
@yadvr yadvr added the Severity:Critical Critical bug label Nov 15, 2021
@yadvr

yadvr commented Nov 18, 2021

Copy link
Copy Markdown
Member

Ping any update/news on this @DaanHoogland cc @sureshanaparti @weizhouapache

@DaanHoogland

Copy link
Copy Markdown
Contributor Author

No @rhtyd , this will need addressing. The original fix caused a regression.

@sureshanaparti

Copy link
Copy Markdown
Contributor

@DaanHoogland can you fix the conflicts. thanks.

@DaanHoogland
DaanHoogland marked this pull request as draft December 22, 2021 14:29
@DaanHoogland
DaanHoogland force-pushed the removeVmWorkJobAfterNicAdd branch from c5675b2 to a46ff06 Compare December 22, 2021 15:21
@apache apache deleted a comment from blueorangutan Dec 22, 2021
@apache apache deleted a comment from blueorangutan Dec 22, 2021
@apache apache deleted a comment from blueorangutan Dec 23, 2021
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from weizhouapache Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from weizhouapache Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@DaanHoogland

Copy link
Copy Markdown
Contributor Author

@sureshanaparti @weizhouapache I finally weeded out the final crinch here, a job was joined twice leading to an SQL exception. It did work but I'll start another test round for both parallel adding and re-adding of a network.
@blueorangutan package

@blueorangutan

Copy link
Copy Markdown

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan

Copy link
Copy Markdown

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 2129

@DaanHoogland
DaanHoogland marked this pull request as ready for review January 7, 2022 12:55
@DaanHoogland

Copy link
Copy Markdown
Contributor Author

fully works for adding in parallel and re-adding. I did notice however that deleting in parallel sometimes doesn't work. We will need to revisit the general area of this functionality again in the future
@blueorangutan test matrix

@blueorangutan

Copy link
Copy Markdown

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@weizhouapache

Copy link
Copy Markdown
Member

fully works for adding in parallel and re-adding. I did notice however that deleting in parallel sometimes doesn't work. We will need to revisit the general area of this functionality again in the future @blueorangutan test matrix

great ! @DaanHoogland

@blueorangutan

Copy link
Copy Markdown

@weizhouapache a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2825)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30933 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2825-kvm-centos7.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2828)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31586 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2828-kvm-centos7.zip
Smoke tests completed. 89 look OK, 3 have errors
Only failed tests results shown below:

Test Result Time (s) Test File
ContextSuite context=TestSnapshotRootDisk>:setup Error 0.00 test_snapshots.py
ContextSuite context=TestRouterIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
ContextSuite context=TestVPCNics>:setup Error 0.00 test_vpc_router_nics.py

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2824)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34903 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2824-xenserver-71.zip
Smoke tests completed. 91 look OK, 1 have errors
Only failed tests results shown below:

Test Result Time (s) Test File
test_01_sys_vm_start Failure 0.12 test_secondary_storage.py

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2829)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34882 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2829-vmware-65u2.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2826)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36578 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2826-vmware-65u2.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan

Copy link
Copy Markdown

Trillian test result (tid-2827)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37773 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2827-xenserver-71.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@yadvr

yadvr commented Jan 8, 2022

Copy link
Copy Markdown
Member

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

@DaanHoogland

Copy link
Copy Markdown
Contributor Author

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

I have tested it but I am (co-)author It has my lgtm ;)
I'll add a brief test description.

@weizhouapache

Copy link
Copy Markdown
Member

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

@rohityadavcloud @DaanHoogland
I have tested it, #5651 is not back. it is good.
I was not able to reproduce #5499, so I am not sure if it is fixed.
code lgtm.

@sureshanaparti sureshanaparti left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

No open projects
Status: Done

Development

Successfully merging this pull request may close these issues.

6 participants