Thursday, August 3, 2017

SCCM SUP WSUS Pool keeps stopping or the server is unresponsive

SCCM SUP WSUS Pool keeps stopping or the server is unresponsive

Scenario: Our WSUS/SUP had become unresponsive and the decision to reinstall the server role was made. After the Site server had been reinstalled  I became aware that Windows Defender updates were failing to update (3 days old) and even though the updates were sync'd, downloaded, and deployed in SCCM the client was still unable to receive them.


Client Log analysis:

ScanAgent.log

ScanJob({999C9FFA-A463-4BE8-8771-67EE96D4140B}): CScanJob::OnScanComplete -Scan Failed with Error=0x80240440
ScanJob({999C9FFA-A463-4BE8-8771-67EE96D4140B}): CScanJobManager::OnScanComplete- failed at CScanJob::OnScanComplete with error=0x80240440



Update Deployment.log

Job error (0x80240440) received for assignment ({bf7a48e6-d220-4070-bb9b-ecc239107584}) action        UpdatesDeploymentAgent       
Updates will not be made available       

WUAHandler.log

Async searching of updates using WUAgent started.       
Async searching completed.       
OnSearchComplete - Failed to end search job. Error = 0x8024401c.        
Scan failed with error = 0x8024401c.        
Its a WSUS Update Source type ({3AAB6A76-CE2D-4E8A-9F11-741AE69677A2}), adding it.        
OS Version is 6.3.9600   
Existing WUA Managed server was already set (http://CMSUP.domain.co.uk:8530), skipping Group Policy registration.        

Added Update Source ({3AAB6A76-CE2D-4E8A-9F11-741AE69677A2}) of content type: 2        

WindowsUpdate.log

Report WARNING: CSerializationHelper:: InitSerialize failed : 0x80070002
AU        WARNING: Failed to get Wu Exemption info from NLM, assuming not exempt, error = 0x80070032
WS        WARNING: Nws Failure: errorCode=0x803d0006
WS        WARNING: Original error code: 0x80072ee2
WS        WARNING: There was an error communicating with the endpoint at 'http://CMSUP.domain.co.uk:8530/ClientWebService/client.asmx'.
WS        WARNING: There was an error receiving the HTTP reply.
WS        WARNING: The operation did not complete within the time allotted.
WS        WARNING: The operation timed out


Analysis Results:
Since I removed the role and put it back it was like the role had been installed for the first time.  Every client within SCCM (9k+) would need to do a Full Software Update & scan cycle. This would generate a heavy load on the ISS pool on the SUP server.  It is very important to configure the pool correctly otherwise the server will stop responding to clients as the client will receive "Service Unavailable" responses similar to DOS.

WSUS Pool Config
Queue Length: 25000
Limit (Percent) 70
Limit Action Throttle
Maximum workers (0 Numa) (1 Default) (2 if you have the server resource, not NUMA)
"Service Unavailable" Response TcpLevel
Failure Interval (Minutes) 30
Maximum Failures 60
Private Memory Limit (KB) 0


Conclusion
 Once we had the SUP role reinstalled synchronizing with SCCM (see WCM.log, Wsyncmgr.log) as well as the correct WSUS pool settings, we notice the server was still spiking CPU with ISS workers taking the full 70% limit without breaks.
Upon reviewing the Client Policy (within SCCM Client Settings) for the estate the "Software Update Scan schedule" was set to 1 day (not the recommended 7 days). This had the affect of overloading the WSUS server with 503 errors in the IIS log "service unavailable". As the schedule was every day the server could not get through the backlog before the whole process began again.
After setting the scan schedule to 7 days, and as clients were checking for policy every hour we notice a steady decline in CPU activity within the hour and all clients were able to complete there scan Software Update & scan cycle  and all clients were able to download Software updates.




34 comments:

  1. Your web journal furnished us with important data to work with. Each and every tips of your post are wonderful. Much obliged for sharing. Continue blogging, swimming pool repair service

    ReplyDelete
  2. Maybe they simply underestimate the transformative possibilities of renovating an existing pool. Don't be intimidated by the task of renovating your pool with the latest industry trends. Swimmingpool

    ReplyDelete
  3. Always do the tiles first. Dirt falls from the tiles as they are being cleaned and settles to the bottom of the pool. If you need to remove stubborn stains with a pumice stone, the pumice itself breaks down as you scrub, depositing debris on the bottom. All American Pool

    ReplyDelete
  4. If you are the owner of a pebble tec pool, you undoubtedly know by know that you need a matching pebble tec patch mix to make most repairs. Pool technicians can cost a fortune and often an effective patch or repair can be made with the right materials (which can easily be bought on the web) and without the added cost. Here are some guidelines to get you started on your DIY pebble Pool Repair project.

    ReplyDelete
  5. Is it a universal thing? Because it keeps happening to me as well. I am just now fed up with it. My server kind of breaks down every other day as well. This one time I got pissed at it as I was in the middle of giving essay writing help UK based and it suffered badly. So I am just going to give it a last go if doesn’t get its act together I will shift to a different server.

    ReplyDelete
  6. It is somewhat fantastic, and yet check out the advice at this treat.. swimming pool pump and filter installation diagram

    ReplyDelete
  7. Online slots, SLOTXO games that are becoming the most popular in 2021 because there are many types of games according to the preferences of the players. Guaranteed to play and pay for real don't cheat players with a financial transaction system 24 hours automatic สล็อต xo เครดิต ฟรี

    ReplyDelete
  8. Jayamix Ultra High Strength Concrete; Jayamix Waterproof Concrete; Jayamix Industrial Floor Concrete; Jayamix Marine Concrete; Jayamix Freezing Room Concrete ... harga beton cor jayamix

    ReplyDelete
  9. The gameplay of Zombs Royale is identical to the Fortnite, and here as well you are going to combat with hundred players online and you need to kill them all to stand triumph in the game. zombs royale unblocked

    ReplyDelete
  10. Deposit and withdraw with a reliable automated system There are more than 100,000 users per day. Unlimited deposits-withdrawals. Login to play online slots here 55xo ... superslotแจกเครดิตฟรี

    ReplyDelete
  11. Why Play Slots at 55XO ? · Support Android and IOS Anywhere · We Have a Safety Policy · Fun in Game We pick from current popularity · Various games We ... สล็อต ค่าย jili เครดิตฟรี

    ReplyDelete
  12. Deposit and withdraw with a reliable automated system There are more than 100,000 users per day. Unlimited deposits-withdrawals. Login to play online slots here 55xo ... สล็อตjili

    ReplyDelete
  13. Egypt's Book of Mystery slot game comes in an Egyptian fiction theme. The characters that will come out in each spin are amazing because they have beautiful visuals, good techniques, and play ... pg slot ฝาก10รับ 100

    ReplyDelete
  14. Top independent celebrity news network with access to breaking celebrity news, Celebrities entertainment news, Net Worth, Hollywood and Bollywood news. at ... Macaulay Culkin Net worth

    ReplyDelete
  15. The new lunch box design idea was inspired by the distinctive shape of the luxury travel trailers brand, Airstream. We tried to give the new lunchbox design ... product development

    ReplyDelete
  16. HOME · EYES · FACE · Lips · REMOVER · Fit Finder · Virtual-Try-On · MAKEUP TIPS · MAKEUP PRODUCT REVIEWS; ลิปสติก

    ReplyDelete
  17. Serum Find the right product for you. including hair care products, hair coloring, makeup, foundation, lipstick and skin care treatments anti wrinkle that meets the needs ... กันแดด

    ReplyDelete
  18. Vouchers Galaxy will provide Mobile Reviews, Android Tips, Android Apps Reviews and much more. Our Main Goal is to Provide Our Customer Valuable Information and ... Top 10 best android apps for creating comics in 2022

    ReplyDelete
  19. NFTMetaverseFinance.com is an NFT, Metaverse and Cryptocurrency news agency where you can discover news about NFTs, Metaverse projects, ... NFTMetaverseFinance.com

    ReplyDelete
  20. Business trip massage Ivy promises to lead the business trip massage network of business trip massage companies through a safe and high satisfaction community to lead by example in Korea, by sharing information transparently. 출장마사지

    ReplyDelete
  21. Blinken, Austin announce $713M in new military aid for Ukraine and allies - the live video is here

    ReplyDelete
  22. In the past decades, we've delivered custom power strip solutions to the top names in the consumer electronics industry. socket extension board

    ReplyDelete
  23. Here at Canada Cloud Pharmacy (Canada pharmacist), we pride ourselves on quality service and the highest standards of patient care. Canadian podcast

    ReplyDelete
  24. Are you driving a jalopy that barely runs? Free Scrap Car Removal BC stands ready to help with all your Surrey junk car problems! Do you own a bucket of bolts that you have no use for? scrap car removal surrey

    ReplyDelete
  25. Goods refer to the items offered for sale on the Service. Orders mean a request by You to purchase Goods from Us. Promotions refer to contests, ... elf bar south africa

    ReplyDelete
  26. Edmonton Cash For Scrap Cars. Junk for Cars Edmonton will come to you and remove your old junk car for cash! We remove junk cars from Edmonton and area. scrap car removals edmonton

    ReplyDelete
  27. Connect to all your home smart switches, buttons and sensors with the Lifesmart General controller. This device allows you to take control of your Lifesmart ... macbook pro

    ReplyDelete
  28. Get your favourite health & wellness products delivered to your doorstep. Natural, Organic, Gluten-free, Cruelty-free, Vegan, Halaal... omega 3

    ReplyDelete
  29. Serving the interests of our clients – Personalized support and relationships matter to us. Because we are owned by banks, we are empowered to deliver top-notch .. Individual Health Insurance Plans

    ReplyDelete
  30. Run 3 Unblocked amazing Free Online Game. It's Run 3 Free Online Game just for Run 3 Game Lovers. You are going to have a great fun via Run 3 unblocked ... run 3 unblocked

    ReplyDelete
  31. Superbly written article, if only all bloggers offered the same content as you, the internet would be a far better place.. hidden wiki

    ReplyDelete
  32. The first version was created in 2007, and every few years there was a new domain. In 2015 the Hidden Wiki was seized by law enforcement. But like a hydra, new alternative sites have been created. One of those sites is hidden wiki

    ReplyDelete
  33. The Fat Burning Kitchen · Diet & Weight Loss. The Fat Burning Kitchen ; Exercise Equipment Mat for Hardwood Floors and Carpet self-help

    ReplyDelete
  34. Pretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I'll be subscribing to your feed and I hope you post again soon. Big thanks for the useful info.
    카지노사이트
    바카라사이트
    우리카지노
    온라인카지노
    온라인바카라
    라이브카지노

    ReplyDelete