CI/CD on PolloChang 工作筆記

SonarQube-API

Fri, 04 Oct 2024 23:44:47 +0800

基本 URL: http:///api

如何驗證
#

創建 API Token
#

登入到 SonarQube 的 Web 界面。
點擊右上角的你的使用者名稱，然後選擇 “我的帳戶 (My Account)”。
在 “安全 (Security)” 標籤中，你會看到一個按鈕 “生成令牌 (Generate Tokens)”。
給令牌命名並點擊生成。生成後記下這個令牌，因為你無法再次查看它。

使用帳號驗證
#

`1`	`curl -k -u <your-token>: '<your-sonarqube-instance/projects/search'`

使用 HTTP Authorization Header
#

以下範例將使用 Authorization Header 方式驗證，方變程式化使用

在 Linux 安裝 JMeter

Thu, 29 Aug 2024 12:03:56 +0800

安裝
#

Down jMeter and deploy it.

JMETER_VERSION="5.6.3"
wget https://dlcdn.apache.org//jmeter/binaries/apache-jmeter-${JMETER_VERSION}.tgz
# 只給自己帳號使用
tar -zxf apache-jmeter-${JMETER_VERSION}.tgz -C ~/.local/share/
cd ~/.local/share/
ln -s apache-jmeter-${JMETER_VERSION} apache-jmeter

setting Desktop Entry for JMeter

JMETER_HOME=${HOME}/.local/share/apache-jmeter
# download JMeter icon to this logo
wget -o ${JMETER_HOME}/logo.svg https://jmeter.apache.org/images/jmeter_square.svg

tee ${HOME}/.local/share/applications/apache-jmeter.desktop <<EOF
[Desktop Entry]
Version=1.0
Type=Application
Name=apache-jmeter
Path=${JMETER_HOME}
Icon=${JMETER_HOME}/logo.svg
Exec=${JMETER_HOME}/bin/jmeter.sh
Comment=apache-jmeter
Categories=Development;
Terminal=false
EOF
# check had created it
cat ${HOME}/.local/share/applications/apache-jmeter.desktop

安裝 plugin
#

jpgc-casutg
#

1
2
3

JMETER_HOME=${HOME}/.local/share/apache-jmeter
wget https://jmeter-plugins.org/files/packages/jpgc-casutg-2.10.zip
unzip -q jpgc-casutg-2.10.zip -d ${JMETER_HOME}

wget -o ${JMETER_HOME}/logo.png https://jmeter.apache.org/images/mstile-144x144.png

透過 Jenkins Pipeline 執行 SonarQube 源碼掃描

Sat, 10 Aug 2024 11:44:47 +0800

環境準備
#

安裝 SonarQube Server
jenknins plugin: SonarQube Scanner

SonarQube
#

Generate SonarQube Token
#

My Account -> Security -> Generate Tokens

透過 Jenkins Pipeline 執行 Jmeter 進行壓力測試

Sat, 10 Aug 2024 08:31:14 +0800

Pipeline script


node {
    stage("set env"){
        
        def BUILDVERSION = sh(script: "echo `date +%s`", returnStdout: true).trim()

        //apache-jmeter目錄
        env.JMETER_HOME="/usr/local/share/apache-jmeter-5.5"
        env.JMETER_REPORT="${BUILDVERSION}.jtl"
        env.JVM_ARGS="-Xms10240m -Xmx10240m"
        //刪除之前測試結果
        // deleteDir()

    }

    stage('refresh jmx'){

    }

    stage('Run JMeter Tests') {
        sh "/usr/local/share/apache-jmeter-5.5/bin/jmeter.sh -n -t /tmp/ntlcPublic.jmx -l ${JMETER_REPORT}"
    }

    stage('Publish Performance Report') {
        perfReport errorFailedThresholds: true, 
            errorUnstableThresholds: true, 
            sourceDataFiles: JMETER_REPORT, 
            relativeFailedThresholdPositive: '90', 
            relativeUnstableThresholdPositive: '80',
            threshold: [
                thresholdName: 'Average Response Time',
                unstableThreshold: '1500',
                failedThreshold: '3000'
            ]
    }
}

perfReport 說明
#

relativeFailedThresholdPositive: ‘90’ 指定了如果 90% 或更多的請求的響應時間超過 failedThreshold，構建將失敗。
relativeUnstableThresholdPositive: ‘80’ 指定了如果 80% 或更多的請求的響應時間超過 unstableThreshold，構建將被標記為不穩定。
threshold 配置了具體的響應時間閾值（如「平均響應時間」）。在這裡，如果平均響應時間超過 1500 毫秒，構建將被標記為不穩定；如果超過 3000 毫秒，構建將失敗。

JMeter

Fri, 09 Aug 2024 22:18:32 +0800

JMeter
#

簡介: 是一款開源的壓力測試工具

jmeter定時器
#

Constant Timer 固定定時器
#

Uniform Random Timer 均勻隨機定時器
#

Constant Throughput Timer 固定吞吐量定時器
#

Gaussian Random Timer 高斯隨機定時器
#

Deviation (in milliseconds): The number shows how much the delay can deviate from the given offset towards the higher and lower range.

時間偏移量

jenkins 安裝

Sun, 05 May 2024 12:03:56 +0800

環境
#

OS: Debian 12, Oracle Linux 9
jenkins version: 2.462.1
jre: adoptium jre 17

安裝
#

安裝必要package
#

Debian

`1`	`sudo apt install -y fontconfig tar zip git wget`

Oracle Linux 9

`1`	`sudo dnf install -y fontconfig tar zip git wget`

部署 tomcat
#

安裝 jre
#

從 adoptium 官方網站下載 java 17
安裝 jre

sudo mkdir -p /usr/local/lib/jvm
sudo tar -zxf ~/OpenJDK17U-jre_x64_linux_hotspot_17.0.12_7.tar.gz -C /usr/local/lib/jvm
cd /usr/local/lib/jvm/
sudo ln -s jdk-17.0.12+7-jre jre-17-latest

安裝 tomcat
#

設定使用者

`1`	`sudo useradd --system -r tomcat -s /sbin/nologin`

sudo useradd --system -r jenkins -s /bin/bash
passwd jenkins
sudo usermod -a -G tomcat jenkins

visudo

tee /etc/sudoers.d/tomcat <<EOF
Cmnd_Alias TOMCAT_SERVICE = /bin/systemctl stop tomcat-*, /bin/systemctl start tomcat-*, /bin/systemctl status tomcat-*, /bin/systemctl restart tomcat-*
jenkins ALL=(ALL)       NOPASSWD: TOMCAT_SERVICE
EOF

sudo mkdir -p /var/tomcat/dump/jenkins \
  /var/log/tomcat/jenkins \
  /opt/apache-tomcat/ \
  /usr/local/etc/catalina/jenkins/{webapps,temp,work} \
  /usr/local/jenkins
sudo chown -R tomcat: /var/log/tomcat
sudo chown -R tomcat: /usr/local/share/apache-tomcat

下載 tomcat 並安裝

wget https://archive.apache.org/dist/tomcat/tomcat-9/v9.0.93/bin/apache-tomcat-9.0.93.tar.gz
sudo tar -zxf ~/apache-tomcat-9.0.93.tar.gz -C /usr/local/share/apache-tomcat
cd /usr/local/share/apache-tomcat
sudo ln -s apache-tomcat-9.0.93 apache-tomcat-9-latest
sudo rm -rf /usr/local/share/apache-tomcat/apache-tomcat-9-latest/webapps/*
sudo rm -rf /usr/local/share/apache-tomcat/apache-tomcat-9-latest/logs/*

sudo mkdir /usr/local/share/apache-tomcat/apache-tomcat-9-latest/logs

sudo chown -R tomcat: /usr/local/share/apache-tomcat
sudo chown -R root: /usr/local/share/apache-tomcat/*/logs
sudo chown -R tomcat: /usr/local/etc/catalina
sudo chown -R tomcat: /var/tomcat/dump
sudo chown -R tomcat: /home/tomcat

設定 tomcat 參數

1
2

sudo  ln -s /var/log/tomcat/jenkins /usr/local/etc/catalina/jenkins/logs
sudo -u tomcat cp -r /opt/apache-tomcat/apache-tomcat-9-latest/conf /usr/local/etc/catalina/jenkins/conf

tee /usr/local/etc/catalina/jenkins/conf/context.xml<<EOF
<?xml version="1.0" encoding="UTF-8"?>
<Context>
    <WatchedResource>WEB-INF/web.xml</WatchedResource>
    <WatchedResource>WEB-INF/tomcat-web.xml</WatchedResource>
    <WatchedResource>\${catalina.base}/conf/web.xml</WatchedResource>
    <Resources cacheMaxSize="51200" cachingAllowed="true"/>
</Context>
EOF

jenkins/conf/server.xml

sudo -u tomcat tee /usr/local/etc/catalina/jenkins/conf/server.xml<<EOF
<?xml version="1.0" encoding="UTF-8"?>
<Server port="-1" shutdown="SHUTDOWN">
  <Listener className="org.apache.catalina.startup.VersionLoggerListener" />
  <Listener className="org.apache.catalina.core.AprLifecycleListener" SSLEngine="on" />
  <Listener className="org.apache.catalina.core.JreMemoryLeakPreventionListener" />
  <Listener className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" />
  <Listener className="org.apache.catalina.core.ThreadLocalLeakPreventionListener" />

  <GlobalNamingResources>
    <Resource name="UserDatabase" auth="Container"
              type="org.apache.catalina.UserDatabase"
              description="User database that can be updated and saved"
              factory="org.apache.catalina.users.MemoryUserDatabaseFactory"
            pathname="conf/tomcat-users.xml" 
            cachingAllowed="false"
            />
  </GlobalNamingResources>

    <Service name="Catalina">

        <Connector port="8080"
               protocol="org.apache.coyote.http11.Http11NioProtocol"
               connectionTimeout="20000"
               redirectPort="8443"
                maxParameterCount="1000"
                disableUploadTimeout= "true"
                server="jenkins"
                URIEncoding= "UTF-8"
               />
    <Engine name="Catalina" defaultHost="localhost">

      <Realm className="org.apache.catalina.realm.LockOutRealm">
        <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
               resourceName="UserDatabase"/>
      </Realm>

      <Host name="localhost"  appBase="webapps"
            unpackWARs="false" autoDeploy="false" reloadable="false"
              >
        <Valve className="org.apache.catalina.valves.RemoteIpValve"
                    internalProxies=".*"
                    remoteIpHeader="x-forwarded-for" proxiesHeader="x-forwarded-by"  protocolHeader="x-forwarded-proto"
                    httpsServerPort="443"
                />
        <Valve className="org.apache.catalina.valves.ErrorReportValve" showReport="false" showServerInfo="false" />
        <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs"
               prefix="localhost_access_log" suffix=".txt"
               pattern="%h %l %u %t &quot;%r&quot; %s %b" />

      </Host>
    </Engine>
  </Service>
</Server>
EOF

設定 daemon

/etc/systemd/system/jenkins.service

sudo tee /etc/systemd/system/jenkins.service<<EOF
[Unit]
Description=Apache Tomcat Web Application Container
After=syslog.target network.target

[Service]
Type=forking

Environment=JAVA_HOME=/usr/local/lib/jvm/jdk17-latest
Environment=CATALINA_PID=/run/jenkins.pid
Environment=CATALINA_HOME=/opt/apache-tomcat/apache-tomcat-9-latest
Environment=CATALINA_BASE=/usr/local/etc/catalina/jenkins

Environment="JENKINS_PREFIX=/jenkins"
Environment="JENKINS_HOME=/usr/local/jenkins"

#CATALINA_OPTS
Environment='CATALINA_OPTS=-server -Xshare:off -Xms2g -Xmx2g -Djava.net.preferIPv4Stack=true -XX:+EliminateLocks -XX:+UseBiasedLocking -XX:MaxJavaStackTraceDepth=100 -XX:+UseG1GC -XX:MaxGCPauseMillis=95'
#JAVA_OPTS
Environment='JAVA_OPTS=-Duser.language=zh -Duser.region=TW -Djava.awt.headless=true -Djava.security.egd=file:/dev/./urandom -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/tomcat/dump'


ExecStart=/usr/local/share/apache-tomcat/apache-tomcat-9-latest/bin/startup.sh
ExecStop=/bin/kill -15 \$MAINPID

User=jenkins
Group=jenkins
UMask=0027
RestartSec=10
Restart=always

[Install]
WantedBy=multi-user.target
EOF

部署 jenkins war
#

1
2
3

wget https://get.jenkins.io/war-stable/2.462.1/jenkins.war
sudo -u tomcat mkdir -p /usr/local/etc/catalina/jenkins/webapps/jenkins
sudo unzip -q jenkins.war -d /usr/local/etc/catalina/jenkins/webapps/jenkins

啟動

1
2
3

sudo systemctl daemon-reload
sudo systemctl restart jenkins && sudo tail -f /var/log/tomcat/jenkins/catalina.out
sudo systemctl enable jenkins

防火牆設定

1
2

sudo firewall-cmd --permanent --add-port=8080/tcp
sudo firewall-cmd --reload

升級
#

sudo systemctl stop jenkins
sydoi rm -rf /usr/local/etc/catalina/jenkins/webapps/jenkins
sudo -u tomcat mkdir -p /usr/local/etc/catalina/jenkins/webapps/jenkins
sudo unzip -q jenkins.war -d /usr/local/etc/catalina/jenkins/webapps/jenkins

CI/CD on PolloChang 工作筆記

SonarQube-API

如何驗證 #

創建 API Token #

使用帳號驗證 #

使用 HTTP Authorization Header #

在 Linux 安裝 JMeter

安裝 #

安裝 plugin #

jpgc-casutg #

透過 Jenkins Pipeline 執行 SonarQube 源碼掃描

環境準備 #

SonarQube #

Generate SonarQube Token #

透過 Jenkins Pipeline 執行 Jmeter 進行壓力測試

perfReport 說明 #

JMeter

JMeter #

jmeter定時器 #

Constant Timer 固定定時器 #

Uniform Random Timer 均勻隨機定時器 #

Constant Throughput Timer 固定吞吐量定時器 #

Gaussian Random Timer 高斯隨機定時器 #

jenkins 安裝

環境 #

安裝 #

安裝必要package #

部署 tomcat #

安裝 jre #

安裝 tomcat #

部署 jenkins war #

升級 #

如何驗證
#

創建 API Token
#

使用帳號驗證
#

使用 HTTP Authorization Header
#

安裝
#

安裝 plugin
#

jpgc-casutg
#

環境準備
#

SonarQube
#

Generate SonarQube Token
#

perfReport 說明
#

JMeter
#

jmeter定時器
#

Constant Timer 固定定時器
#

Uniform Random Timer 均勻隨機定時器
#

Constant Throughput Timer 固定吞吐量定時器
#

Gaussian Random Timer 高斯隨機定時器
#

環境
#

安裝
#

安裝必要package
#

部署 tomcat
#

安裝 jre
#

安裝 tomcat
#

部署 jenkins war
#

升級
#