6 Replies Latest reply on Nov 7, 2019 1:20 AM by Ondrej Kieler

    Consolidation jobs are taking really long time

    Ondrej Kieler
      Share This:

      Hello,

       

      we are running the consolidation cluster (failover) consisting of three appliances (version 11.3.0.5) with latest TKUs. All machines in cluster have 12 CPUs and 48 GBs of RAM and additional 32 GBs of swap. We are consolidating the runs from 9 appliances with the same version. We are scanning around 9500 servers and we have already modeled around 2000 applications. We started at 8 CPUs for each machine and with 32 GBs of RAM then we add additional CPUs and RAM by situation is not getting better.

       

      The scan schedule is set up in a way that no more then three runs is starting simultanously on different scanners, but scans which take for example 4 hours on scanner are consolidated after more then one day. The consolidation usually starts quite fast but it stuck at 99 % and last one percent is taking hours to be completed. I was checking the performance and we are about 50% of CPU usage, RAM and swap is fully utilized. Currently we have around 45 runs in queue.

       

      When I am checking the tw_svc_eca_perf_engine.log there are some periods when engines are doing almost anything for qiute long time:

             

      E03-2019-11-0513:45:38,632:Queued2pushes0pops0
      E02-2019-11-0513:45:43,201:Queued2pushes0pops0
      E09-2019-11-0513:45:44,366:Queued70pushes0pops49
      E07-2019-11-0513:45:50,605:Queued2pushes620pops773
      E08-2019-11-0513:45:57,853:Queued2pushes0pops0
      E00-2019-11-0513:50:28,841:Queued156pushes0pops0
      E06-2019-11-0513:50:29,935:Queued2pushes0pops0
      E05-2019-11-0513:50:30,438:Queued3pushes0pops0
      E01-2019-11-0513:50:30,725:Queued2pushes318pops514
      E03-2019-11-0513:50:38,633:Queued2pushes448pops448
      E04-2019-11-0513:50:40,471:Queued679pushes0pops0
      E02-2019-11-0513:50:43,201:Queued2pushes0pops0
      E09-2019-11-0513:50:44,366:Queued36pushes0pops34
      E07-2019-11-0513:50:50,606:Queued2pushes0pops0
      E08-2019-11-0513:50:57,855:Queued2pushes0pops0
      E00-2019-11-0513:55:28,842:Queued156pushes0pops0
      E06-2019-11-0513:55:29,935:Queued2pushes307pops307
      E05-2019-11-0513:55:30,438:Queued3pushes0pops0
      E01-2019-11-0513:55:30,725:Queued2pushes0pops0
      E03-2019-11-0513:55:38,633:Queued2pushes0pops0
      E04-2019-11-0513:55:40,484:Queued679pushes0pops0
      E09-2019-11-0513:55:44,367:Queued3pushes0pops33
      E02-2019-11-0513:55:45,633:Queued2pushes0pops0
      E07-2019-11-0513:55:52,628:Queued2pushes0pops0
      E08-2019-11-0513:55:57,859:Queued2pushes186pops186
      E00-2019-11-0514:00:28,842:Queued2pushes0pops154
      E06-2019-11-0514:00:29,937:Queued2pushes0pops0
      E05-2019-11-0514:00:30,438:Queued2pushes191pops192
      E01-2019-11-0514:00:30,726:Queued2pushes0pops0
      E03-2019-11-0514:00:38,633:Queued2pushes0pops0
      E04-2019-11-0514:00:40,485:Queued679pushes0pops0
      E09-2019-11-0514:00:44,413:Queued2pushes274pops275
      E02-2019-11-0514:00:45,642:Queued2pushes0pops0
      E07-2019-11-0514:00:52,648:Queued2pushes0pops0
      E08-2019-11-0514:00:57,859:Queued2pushes0pops0
      E00-2019-11-0514:05:28,843:Queued2pushes290pops290
      E06-2019-11-0514:05:30,004:Queued2pushes0pops0
      E05-2019-11-0514:05:30,439:Queued2pushes0pops0
      E01-2019-11-0514:05:30,726:Queued2pushes0pops0
      E03-2019-11-0514:05:38,635:Queued2pushes0pops0
      E04-2019-11-0514:05:40,485:Queued679pushes0pops0
      E09-2019-11-0514:05:44,415:Queued2pushes0pops0
      E02-2019-11-0514:05:46,042:Queued2pushes426pops426
      E07-2019-11-0514:05:52,649:Queued2pushes0pops0
      E08-2019-11-0514:05:57,860:Queued2pushes0pops0
      E00-2019-11-0514:10:28,844:Queued2pushes0pops0
      E06-2019-11-0514:10:30,012:Queued2pushes0pops0
      E05-2019-11-0514:10:30,439:Queued2pushes0pops0
      E01-2019-11-0514:10:30,727:Queued2pushes0pops0
      E03-2019-11-0514:10:38,635:Queued2pushes0pops0
      E04-2019-11-0514:10:40,485:Queued679pushes0pops0
      E09-2019-11-0514:10:44,415:Queued2pushes0pops0
      E02-2019-11-0514:10:46,047:Queued2pushes0pops0
      E07-2019-11-0514:10:52,649:Queued2pushes710pops710
      E08-2019-11-0514:10:57,860:Queued2pushes0pops0
      E00-2019-11-0514:15:28,845:Queued2pushes0pops0
      E06-2019-11-0514:15:30,013:Queued2pushes0pops0
      E05-2019-11-0514:15:30,439:Queued2pushes0pops0
      E01-2019-11-0514:15:32,479:Queued2pushes0pops0
      E03-2019-11-0514:15:38,636:Queued2pushes0pops0
      E04-2019-11-0514:15:40,486:Queued679pushes0pops0
      E09-2019-11-0514:15:44,415:Queued2pushes0pops0
      E02-2019-11-0514:15:46,047:Queued2pushes0pops0
      E07-2019-11-0514:15:52,650:Queued2pushes0pops0
      E08-2019-11-0514:16:00,281:Queued2pushes0pops0
      E00-2019-11-0514:20:28,845:Queued2pushes0pops0
      E06-2019-11-0514:20:30,014:Queued2pushes0pops0
      E05-2019-11-0514:20:30,440:Queued2pushes0pops0
      E01-2019-11-0514:20:32,490:Queued2pushes0pops0
      E03-2019-11-0514:20:38,636:Queued2pushes0pops0
      E04-2019-11-0514:20:40,486:Queued2pushes582pops1259
      E09-2019-11-0514:20:44,416:Queued2pushes0pops0
      E02-2019-11-0514:20:47,321:Queued2pushes0pops0
      E07-2019-11-0514:20:52,650:Queued2pushes0pops0
      E08-2019-11-0514:21:00,302:Queued2pushes0pops0
      E00-2019-11-0514:25:28,846:Queued2pushes0pops0
      E06-2019-11-0514:25:30,014:Queued2pushes0pops0
      E05-2019-11-0514:25:30,440:Queued2pushes0pops0
      E01-2019-11-0514:25:32,490:Queued2pushes0pops0
      E03-2019-11-0514:25:38,661:Queued2pushes0pops0
      E04-2019-11-0514:25:40,486:Queued2pushes0pops0
      E09-2019-11-0514:25:44,416:Queued2pushes0pops0
      E02-2019-11-0514:25:47,323:Queued2pushes0pops0
      E07-2019-11-0514:25:54,558:Queued2pushes0pops0
      E08-2019-11-0514:26:00,303:Queued2pushes0pops0
      E00-2019-11-0514:30:28,846:Queued2pushes0pops0
      E06-2019-11-0514:30:30,015:Queued2pushes0pops0
      E05-2019-11-0514:30:30,442:Queued2pushes0pops0
      E01-2019-11-0514:30:33,252:Queued2pushes0pops0
      E03-2019-11-0514:30:38,664:Queued2pushes0pops0
      E04-2019-11-0514:30:40,487:Queued2pushes0pops0
      E09-2019-11-0514:30:44,417:Queued2pushes0pops0
      E02-2019-11-0514:30:49,197:Queued2pushes0pops0
      E07-2019-11-0514:30:55,885:Queued2pushes0pops0
      E08-2019-11-0514:31:00,303:Queued2pushes0pops0
      E00-2019-11-0514:35:28,847:Queued2pushes0pops0
      E05-2019-11-0514:35:30,445:Queued2pushes0pops0
      E06-2019-11-0514:35:31,693:Queued2pushes0pops0
      E01-2019-11-0514:35:35,358:Queued2pushes0pops0
      E03-2019-11-0514:35:40,078:Queued2pushes0pops0
      E04-2019-11-0514:35:41,643:Queued2pushes0pops0
      E09-2019-11-0514:35:44,417:Queued2pushes0pops0
      E02-2019-11-0514:35:49,198:Queued2pushes0pops0
      E07-2019-11-0514:35:55,887:Queued2pushes0pops0
      E08-2019-11-0514:36:00,303:Queued2pushes0pops0
      E00-2019-11-0514:40:28,847:Queued2pushes0pops0
      E05-2019-11-0514:40:30,446:Queued2pushes0pops0
      E06-2019-11-0514:40:31,694:Queued2pushes0pops0
      E01-2019-11-0514:40:35,360:Queued2pushes0pops0
      E04-2019-11-0514:40:41,644:Queued2pushes0pops0
      E03-2019-11-0514:40:42,356:Queued2pushes0pops0
      E09-2019-11-0514:40:44,418:Queued3pushes1pops0
      E02-2019-11-0514:40:49,198:Queued2pushes0pops0
      E07-2019-11-0514:40:55,920:Queued2pushes0pops0
      E08-2019-11-0514:41:00,304:Queued2pushes0pops0
      E00-2019-11-0514:45:28,847:Queued2pushes0pops0
      E05-2019-11-0514:45:30,447:Queued2pushes0pops0
      E06-2019-11-0514:45:31,694:Queued2pushes0pops0
      E01-2019-11-0514:45:35,725:Queued2pushes785pops785
      E03-2019-11-0514:45:43,199:Queued2pushes547pops547
      E04-2019-11-0514:45:44,192:Queued2pushes0pops0
      E09-2019-11-0514:45:47,282:Queued3pushes0pops0
      E02-2019-11-0514:45:49,198:Queued2pushes0pops0
      E07-2019-11-0514:45:55,921:Queued2pushes0pops0
      E08-2019-11-0514:46:00,304:Queued2pushes0pops0
      E00-2019-11-0514:50:28,848:Queued2pushes0pops0
      E06-2019-11-0514:50:31,694:Queued2pushes0pops0
      E05-2019-11-0514:50:32,148:Queued2pushes0pops0
      E01-2019-11-0514:50:35,727:Queued2pushes0pops0
      E03-2019-11-0514:50:43,200:Queued2pushes0pops0
      E04-2019-11-0514:50:44,193:Queued2pushes0pops0
      E09-2019-11-0514:50:47,282:Queued3pushes0pops0
      E02-2019-11-0514:50:49,199:Queued2pushes0pops0
      E07-2019-11-0514:50:55,921:Queued2pushes0pops0
      E08-2019-11-0514:51:00,326:Queued2pushes0pops0
      E00-2019-11-0514:55:28,849:Queued2pushes0pops0
      E06-2019-11-0514:55:31,695:Queued2pushes463pops463
      E05-2019-11-0514:55:32,153:Queued2pushes0pops0
      E01-2019-11-0514:55:35,727:Queued2pushes0pops0
      E03-2019-11-0514:55:43,200:Queued2pushes0pops0
      E04-2019-11-0514:55:44,193:Queued2pushes0pops0
      E09-2019-11-0514:55:47,282:Queued2pushes539pops540
      E02-2019-11-0514:55:49,199:Queued2pushes0pops0
      E07-2019-11-0514:55:55,929:Queued2pushes0pops0
      E08-2019-11-0514:56:04,416:Queued2pushes0pops0
      E00-2019-11-0515:00:28,849:Queued2pushes438pops438
      E06-2019-11-0515:00:31,696:Queued2pushes0pops0
      E05-2019-11-0515:00:32,153:Queued2pushes504pops504
      E01-2019-11-0515:00:35,727:Queued2pushes0pops0
      E03-2019-11-0515:00:43,201:Queued2pushes0pops0
      E04-2019-11-0515:00:44,194:Queued2pushes0pops0
      E09-2019-11-0515:00:47,283:Queued2pushes0pops0
      E02-2019-11-0515:00:49,202:Queued2pushes0pops0
      E07-2019-11-0515:00:55,932:Queued2pushes0pops0
      E08-2019-11-0515:01:04,472:Queued2pushes0pops0
      E00-2019-11-0515:05:29,473:Queued2pushes0pops0
      E06-2019-11-0515:05:31,697:Queued2pushes0pops0
      E05-2019-11-0515:05:32,154:Queued2pushes0pops0
      E01-2019-11-0515:05:35,728:Queued2pushes0pops0
      E03-2019-11-0515:05:43,201:Queued2pushes0pops0
      E04-2019-11-0515:05:44,194:Queued2pushes0pops0
      E09-2019-11-0515:05:47,283:Queued2pushes0pops0
      E02-2019-11-0515:05:49,202:Queued2pushes0pops0
      E07-2019-11-0515:05:55,933:Queued2pushes585pops585
      E08-2019-11-0515:06:04,472:Queued2pushes0pops0
      E00-2019-11-0515:10:29,480:Queued2pushes0pops0
      E06-2019-11-0515:10:31,697:Queued2pushes0pops0
      E05-2019-11-0515:10:32,154:Queued2pushes0pops0
      E01-2019-11-0515:10:35,728:Queued2pushes0pops0
      E03-2019-11-0515:10:43,201:Queued2pushes0pops0
      E04-2019-11-0515:10:44,195:Queued2pushes0pops0
      E09-2019-11-0515:10:47,284:Queued2pushes0pops0
      E02-2019-11-0515:10:52,703:Queued2pushes0pops0
      E07-2019-11-0515:10:56,915:Queued2pushes0pops0
      E08-2019-11-0515:11:04,472:Queued2pushes0pops0
      E00-2019-11-0515:15:29,481:Queued2pushes0pops0
      E06-2019-11-0515:15:31,722:Queued2pushes0pops0
      E05-2019-11-0515:15:32,155:Queued2pushes0pops0
      E01-2019-11-0515:15:35,728:Queued2pushes0pops0
      E03-2019-11-0515:15:43,202:Queued2pushes0pops0
      E04-2019-11-0515:15:44,196:Queued2pushes0pops0
      E09-2019-11-0515:15:47,284:Queued2pushes0pops0
      E02-2019-11-0515:15:52,704:Queued2pushes0pops0
      E07-2019-11-0515:15:56,915:Queued2pushes0pops0
      E08-2019-11-0515:16:04,473:Queued2pushes0pops0
      E00-2019-11-0515:20:29,481:Queued2pushes0pops0
      E06-2019-11-0515:20:31,724:Queued2pushes0pops0
      E05-2019-11-0515:20:33,360:Queued2pushes0pops0
      E01-2019-11-0515:20:35,729:Queued2pushes0pops0
      E04-2019-11-0515:20:44,199:Queued2pushes496pops496
      E03-2019-11-0515:20:45,028:Queued2pushes0pops0
      E09-2019-11-0515:20:47,285:Queued2pushes0pops0
      E02-2019-11-0515:20:52,704:Queued36pushes406pops372
      E07-2019-11-0515:20:56,915:Queued2pushes0pops0
      E08-2019-11-0515:21:04,473:Queued2pushes0pops0
      E00-2019-11-0515:25:31,265:Queued2pushes0pops0
      E06-2019-11-0515:25:31,725:Queued2pushes0pops0
      E05-2019-11-0515:25:33,367:Queued2pushes0pops0
      E01-2019-11-0515:25:35,729:Queued2pushes0pops0
      E04-2019-11-0515:25:44,201:Queued2pushes0pops0
      E03-2019-11-0515:25:45,034:Queued2pushes0pops0
      E09-2019-11-0515:25:48,733:Queued2pushes0pops0
      E02-2019-11-0515:25:52,704:Queued2pushes15pops49
      E07-2019-11-0515:25:56,917:Queued2pushes0pops0
      E08-2019-11-0515:26:04,473:Queued2pushes0pops0
      E00-2019-11-0515:30:31,267:Queued2pushes0pops0
      E06-2019-11-0515:30:31,727:Queued2pushes0pops0
      E05-2019-11-0515:30:33,368:Queued2pushes0pops0
      E01-2019-11-0515:30:35,730:Queued2pushes0pops0
      E04-2019-11-0515:30:44,858:Queued2pushes0pops0
      E03-2019-11-0515:30:45,034:Queued2pushes0pops0
      E09-2019-11-0515:30:51,969:Queued2pushes0pops0
      E02-2019-11-0515:30:52,705:Queued2pushes0pops0
      E07-2019-11-0515:30:56,917:Queued2pushes0pops0
      E08-2019-11-0515:31:04,474:Queued2pushes547pops547
      E00-2019-11-0515:35:31,267:Queued2pushes0pops0
      E06-2019-11-0515:35:31,727:Queued2pushes0pops0
      E05-2019-11-0515:35:33,368:Queued2pushes0pops0
      E01-2019-11-0515:35:38,604:Queued2pushes0pops0
      E04-2019-11-0515:35:44,859:Queued2pushes0pops0
      E03-2019-11-0515:35:46,230:Queued2pushes0pops0
      E09-2019-11-0515:35:52,017:Queued2pushes0pops0
      E02-2019-11-0515:35:52,705:Queued2pushes0pops0
      E07-2019-11-0515:35:57,820:Queued2pushes0pops0
      E08-2019-11-0515:36:04,474:Queued2pushes0pops0
      E00-2019-11-0515:40:31,268:Queued2pushes0pops0
      E06-2019-11-0515:40:31,728:Queued2pushes0pops0
      E05-2019-11-0515:40:33,368:Queued2pushes0pops0
      E01-2019-11-0515:40:38,611:Queued2pushes0pops0
      E04-2019-11-0515:40:44,859:Queued2pushes0pops0
      E03-2019-11-0515:40:46,268:Queued2pushes0pops0
      E09-2019-11-0515:40:52,017:Queued2pushes0pops0
      E02-2019-11-0515:40:53,065:Queued2pushes0pops0
      E07-2019-11-0515:40:57,821:Queued2pushes0pops0
      E08-2019-11-0515:41:04,770:Queued2pushes0pops0
      E00-2019-11-0515:45:31,268:Queued2pushes0pops0
      E06-2019-11-0515:45:31,728:Queued2pushes0pops0
      E05-2019-11-0515:45:34,318:Queued2pushes0pops0
      E01-2019-11-0515:45:41,002:Queued2pushes0pops0
      E04-2019-11-0515:45:44,860:Queued2pushes0pops0
      E03-2019-11-0515:45:46,268:Queued2pushes0pops0
      E09-2019-11-0515:45:52,018:Queued2pushes0pops0
      E02-2019-11-0515:45:55,141:Queued2pushes0pops0
      E07-2019-11-0515:45:57,821:Queued2pushes0pops0
      E08-2019-11-0515:46:04,798:Queued2pushes0pops0
      E00-2019-11-0515:50:31,268:Queued2pushes0pops0
      E05-2019-11-0515:50:34,319:Queued2pushes0pops0
      E06-2019-11-0515:50:36,813:Queued2pushes0pops0
      E01-2019-11-0515:50:41,018:Queued2pushes279pops279
      E03-2019-11-0515:50:46,269:Queued2pushes0pops0
      E04-2019-11-0515:50:47,215:Queued2pushes0pops0
      E09-2019-11-0515:50:52,018:Queued2pushes0pops0
      E02-2019-11-0515:50:55,143:Queued2pushes0pops0
      E07-2019-11-0515:50:57,822:Queued2pushes0pops0
      E08-2019-11-0515:51:04,799:Queued2pushes0pops0
      E00-2019-11-0515:55:31,269:Queued2pushes0pops0
      E05-2019-11-0515:55:34,319:Queued2pushes0pops0
      E06-2019-11-0515:55:36,814:Queued2pushes0pops0
      E01-2019-11-0515:55:41,019:Queued2pushes0pops0
      E03-2019-11-0515:55:46,269:Queued2pushes383pops383
      E04-2019-11-0515:55:47,215:Queued2pushes0pops0
      E09-2019-11-0515:55:52,019:Queued2pushes0pops0
      E02-2019-11-0515:55:55,143:Queued2pushes0pops0
      E07-2019-11-0515:55:57,822:Queued2pushes0pops0
      E08-2019-11-0515:56:04,799:Queued2pushes0pops0
      E00-2019-11-0516:00:31,269:Queued2pushes0pops0
      E05-2019-11-0516:00:34,320:Queued2pushes0pops0
      E06-2019-11-0516:00:36,814:Queued2pushes0pops0
      E01-2019-11-0516:00:41,019:Queued2pushes0pops0
      E03-2019-11-0516:00:46,270:Queued2pushes0pops0
      E04-2019-11-0516:00:47,216:Queued2pushes0pops0
      E09-2019-11-0516:00:52,020:Queued2pushes0pops0
      E02-2019-11-0516:00:55,144:Queued2pushes0pops0
      E07-2019-11-0516:00:57,823:Queued2pushes0pops0
      E08-2019-11-0516:01:05,280:Queued2pushes0pops0
      E00-2019-11-0516:05:31,270:Queued2pushes0pops0
      E05-2019-11-0516:05:34,320:Queued2pushes0pops0
      E06-2019-11-0516:05:36,815:Queued2pushes0pops0
      E01-2019-11-0516:05:41,020:Queued2pushes0pops0
      E03-2019-11-0516:05:46,270:Queued2pushes0pops0
      E04-2019-11-0516:05:47,216:Queued2pushes0pops0
      E09-2019-11-0516:05:52,020:Queued2pushes0pops0
      E02-2019-11-0516:05:55,144:Queued2pushes0pops0
      E07-2019-11-0516:05:57,823:Queued2pushes0pops0
      E08-2019-11-0516:06:05,281:Queued2pushes0pops0
      E00-2019-11-0516:10:31,270:Queued2pushes0pops0
      E05-2019-11-0516:10:34,320:Queued2pushes0pops0
      E06-2019-11-0516:10:36,818:Queued2pushes0pops0
      E01-2019-11-0516:10:41,021:Queued2pushes0pops0
      E03-2019-11-0516:10:46,271:Queued2pushes0pops0
      E04-2019-11-0516:10:47,217:Queued2pushes0pops0
      E09-2019-11-0516:10:52,021:Queued1pushes0pops1
      E02-2019-11-0516:10:55,144:Queued2pushes0pops0
      E07-2019-11-0516:10:59,492:Queued2pushes0pops0
      E08-2019-11-0516:11:05,281:Queued2pushes0pops0
      E00-2019-11-0516:15:31,270:Queued2pushes0pops0

       

      Can you please give me any recommendation where to start looking, what to check?

       

      Thanks a lot in advance,

       

      Ondrej

        • 1. Re: Consolidation jobs are taking really long time
          Andrew Waters

          Modelled 2000 applications how? SAAM? CAM? Patterns? Do they have lots of nodes?

           

          Have you looked at the pattern performance page? Do any appear to be tacking a really long time?

          • 2. Re: Consolidation jobs are taking really long time
            Ondrej Kieler

            They are all created via SAAM. This is quick overview about the numbers:

             

            29 apps have around 3500 servers

            28 apps have 1000 - 1700 servers

            19 apps have 500 - 1000 servers

            128 apps have 100 - 500 servers

            68 apps have 50 - 100 servers

            96 apps have 30 - 50 servers

            81 apps have 20 -30 servers

            178 apps have 10 - 20 servers

            1315 apps have 1 - 10 servers

             

            Yes, I also checked the pattern performance page. There is the top five for longest execution times:

            Average execution time:

              

            Pattern NameAverage Execution Time
            Oracle.Clusterware.Clusterware8.74
            NetScalerVPX_LoadBalancer.NetScalerVPX_LoadBalancer5.36
            Cisco_UCS.CiscoUCS4.52
            NetApp_Storage.NetAppStorage2.94
            F5_BIG_IP_LoadBalancer.F5_BIG_IP_LoadBalancer

            1.5

             

            Total execution time:

              

            Pattern NameTotal Execution Time
            Oracle.OracleRDBMS.DatabaseServer650.64
            SupportDetail.SoftwareInstance.SoftwareInstance_SD568.78
            SupportingFiles.NVD_Database_Linking.NVD_SI_Data280.53
            ScheduledTasksInfo.TaskScheduler.WindowsTaskScheduler250.55
            Oracle.Clusterware.Clusterware209.66

             

            Average modelling time:

              

            Pattern NameAverage Modelling Time
            Oracle.Clusterware.Clusterware1.31
            NetScalerVPX_LoadBalancer.NetScalerVPX_LoadBalancer0.84
            Cisco_UCS.CiscoUCS0.68
            NetApp_Storage.NetAppStorage0.57
            F5_BIG_IP_LoadBalancer.F5_BIG_IP_LoadBalancer0.21

             

            Average Inferencing Time:

              

            Pattern NameAverage Inferencing Time
            Oracle.Clusterware.Clusterware5.58
            NetScalerVPX_LoadBalancer.NetScalerVPX_LoadBalancer3.66
            Cisco_UCS.CiscoUCS3.04
            NetApp_Storage.NetAppStorage1.61
            F5_BIG_IP_LoadBalancer.F5_BIG_IP_LoadBalancer

            1.14

             

             

            It seems to me that they are not taking really long time.

            • 3. Re: Consolidation jobs are taking really long time
              Ondrej Kieler

              But it seems to me also that our application modellers haven't modelled the Applications correctly as I cannot imagine that we have some application with 3500 nodes in it

              • 4. Re: Consolidation jobs are taking really long time
                Andrew Waters

                My guess is that it is taking a long tie to update the very large models. It is hard to be sure though without reasoning log levels being set to debug.

                 

                If there are messages about updating model definitions and not a lot else in the tw_svc_eca_engine.log files then that would indicate it being the cause.

                • 5. Re: Consolidation jobs are taking really long time
                  Ondrej Kieler

                  Ok. I will set them to debug for some time and then check it but this was my guess also. What would you recommend if the models will need to be really so large? Addittional RAM?

                  • 6. Re: Consolidation jobs are taking really long time
                    Ondrej Kieler

                    What I should search for reasoning logs after setting them to debug? In tw_svc_reasoning.log I see that it is only opening the persistent files.