程式扎記

屬性 : 系統相關 - 文書編輯
語法 : cut [參數] [檔案名稱]
參數 | 功能

-b 輸出範圍 | 輸出指定的bytes數或是範圍
-c 輸出範圍 | 輸出指定的位元數或式範圍
-d 分隔字元 | 指定分隔欄位的字元
-f 輸出範圍 | 設定輸出的範圍
-s | 若該行沒有分隔欄字元, 則不顯示該行

執行範例 :
* 將 /etc/passwd 當中的內容每行的前三個字取出:

# server1:~ # cut -b 1-3 /etc/passwd
at:
bin
cyr
dae
dhc
...(以下省略)...

* 使用:為分隔符將 /etc/passwd當中的帳號與根目錄列出

# server1:~ # cut -f 1,6 -d : /etc/passwd <由於帳號在第一欄位, 根目錄在第六欄位, 故使用-f 1,6>
at:/var/spool/atjobs
bin:/bin
cyrus:/usr/lib/cyrus
daemon:/sbin
dhcpd:/var/lib/dhcp
...(以下省略)...

補充說明 :
當檔案一行中有多項欄位時, 可透過此指令將我們需要的欄位取出.
* 鳥哥私房菜 - 認識與學習 BASH : 擷取命令： cut, grep

# cut -d'分隔字元' -f fields <==用於有特定分隔字元
# cut -c 字元區間 <==用於排列整齊的訊息

This message was edited 5 times. Last update was at 29/08/2013 21:33:23

Preface:
ActiveMQ 最常為人知的是 Asynchronous message 的使用, 事實上它也可以用來實作 request/reply 的 synchronous client/server 架構. 而更之甚者, 它的好處是除了保留 request/reply 的原味外, 又增加了許多好處. 例如你可以在不停止系統下動態的增加 workload 以服務更多的 client. 底下是其實作的概念圖:

底下的範例代碼只說明使用的框架代碼, 實際的商業邏輯就因人而異.

Sample Code:
下面的代碼是來自 ActiveMQ In Action 第七章的 "Implementing request/reply with JMS" 節, 首先要來看的是 Broker 與 Worker 啟動的代碼. 這邊為了簡化 Broker 的啟動流程, 使用的是 Java Embedded 的 Broker; 而在使用 request/reply 的 message 傳輸時必須要有一個類似 TCP 的 session id, 這樣才知道哪個 reply 要配哪個 request, 而這個功能的實現是透過設定 Message 的JMSCorrelationID 屬性. 因為 Message 並不是直接送到 Worker 端, 所以 reply 的 destination 必須要透過 Client 設定 Message 的屬性 JMSReplyTo 得知. 有了這些概念, 就來看看 Broker+Worker 的代碼吧:
- Server.java

view plaincopy to clipboardprint?
package ch7;  
  
import javax.jms.Connection;  
import javax.jms.DeliveryMode;  
import javax.jms.Destination;  
import javax.jms.JMSException;  
import javax.jms.Message;  
import javax.jms.MessageConsumer;  
import javax.jms.MessageListener;  
import javax.jms.MessageProducer;  
import javax.jms.Session;  
import javax.jms.TextMessage;  
  
import org.apache.activemq.ActiveMQConnectionFactory;  
import org.apache.activemq.broker.BrokerService;  
  
public class Server implements MessageListener {  
    private String brokerUrl = "tcp://0.0.0.0:61616";  
    private String requestQueue = "requests";  
  
    private BrokerService broker;  
    private Session session;  
    private MessageProducer producer;  
    private MessageConsumer consumer;  
  
    public void start() throws Exception {  
        createBroker();  
        setupConsumer();  
    }  
  
    private void createBroker() throws Exception {  
        broker = new BrokerService();  
        broker.setPersistent(false);  
        broker.setUseJmx(false);  
        broker.addConnector(brokerUrl);  
        broker.start();  
    }  
  
    private void setupConsumer() throws JMSException {  
        ActiveMQConnectionFactory connectionFactory = new ActiveMQConnectionFactory(brokerUrl);  
  
        Connection connection;  
        connection = connectionFactory.createConnection();  
        connection.start();  
        session = connection.createSession(false, Session.AUTO_ACKNOWLEDGE);  
        Destination adminQueue = session.createQueue(requestQueue);  
  
        producer = session.createProducer(null);  
        producer.setDeliveryMode(DeliveryMode.NON_PERSISTENT);  
  
        consumer = session.createConsumer(adminQueue);  
        consumer.setMessageListener(this);  
    }  
  
    public void stop() throws Exception {  
        producer.close();  
        consumer.close();  
        session.close();  
        broker.stop();  
    }  
  
    public void onMessage(Message message) {  
        try {  
            TextMessage response = this.session.createTextMessage();  
            if (message instanceof TextMessage) {  
                TextMessage txtMsg = (TextMessage) message;  
                String messageText = txtMsg.getText();  
                response.setText(handleRequest(messageText));  
            }  
  
            response.setJMSCorrelationID(message.getJMSCorrelationID());  
  
            producer.send(message.getJMSReplyTo(), response);  
        } catch (JMSException e) {  
            e.printStackTrace();  
        }  
    }  
  
    public String handleRequest(String messageText) {  
        return "Response to '" + messageText + "'";  
    }  
  
    public static void main(String[] args) throws Exception {  
        Server server = new Server();  
        server.start();  
  
        System.out.println();  
        System.out.println("Press any key to stop the server");  
        System.out.println();  
  
        System.in.read();  
  
        server.stop();  
    }  
}  

接著來看 Client 端的代碼, 在 Client 端一樣有 Consumer/Producer 的 agent, Producer 就是用來發送訊息到 "Request queue"; Consumer 是透過 session.createTemporaryQueue() 建立的 temple queue (名稱並不重要, 只是一個中介), 用來讓 Worker 有個地方可以送回 reply 的 Message. 另外 Client 再送出 request Message 前必須要做兩件事:

- 設定 JMSCorrelationID, 這樣才知道收到的 reply 是屬於哪個 request.
- 設定 JMSReplyTo, 這樣 Client 才知道送到哪去.

如此下面的 Client 代碼便不難了解了:
- Client.java

view plaincopy to clipboardprint?
package ch7;  
  
import java.util.UUID;  
  
import javax.jms.Connection;  
import javax.jms.DeliveryMode;  
import javax.jms.Destination;  
import javax.jms.JMSException;  
import javax.jms.Message;  
import javax.jms.MessageConsumer;  
import javax.jms.MessageListener;  
import javax.jms.MessageProducer;  
import javax.jms.Session;  
import javax.jms.TextMessage;  
  
import org.apache.activemq.ActiveMQConnectionFactory;  
  
public class Client implements MessageListener {  
    private String brokerUrl = "tcp://0.0.0.0:61616";  
    private String requestQueue = "requests";  
      
    Connection connection;  
    private Session session;  
    private MessageProducer producer;  
    private MessageConsumer consumer;  
      
    private Destination tempDest;  
      
    public void start() throws JMSException {  
            ActiveMQConnectionFactory connectionFactory = new ActiveMQConnectionFactory(  
                            brokerUrl);  
            connection = connectionFactory.createConnection();  
            connection.start();  
            session = connection.createSession(false, Session.AUTO_ACKNOWLEDGE);  
            Destination adminQueue = session.createQueue(requestQueue);  
  
            producer = session.createProducer(adminQueue);  
            producer.setDeliveryMode(DeliveryMode.NON_PERSISTENT);  
  
            tempDest = session.createTemporaryQueue();  
            consumer = session.createConsumer(tempDest);  
  
            consumer.setMessageListener(this);  
    }  
  
    public void stop() throws JMSException {  
            producer.close();  
            consumer.close();  
            session.close();  
            connection.close();  
    }  
      
    public void request(String request) throws JMSException {  
            System.out.println("Requesting: " + request);  
            TextMessage txtMessage = session.createTextMessage();  
            txtMessage.setText(request);  
  
            txtMessage.setJMSReplyTo(tempDest);  
  
            String correlationId = UUID.randomUUID().toString();  
            txtMessage.setJMSCorrelationID(correlationId);  
            this.producer.send(txtMessage);  
    }  
  
    public void onMessage(Message message) {  
            try {  
                    System.out.println("Received response for: "  
                                    + ((TextMessage) message).getText());  
            } catch (JMSException e) {  
                    e.printStackTrace();  
            }  
    }  
      
    public static void main(String[] args) throws Exception {  
            Client client = new Client();  
            client.start();  
            int i = 0;  
            while (i++ < 10) {  
                    client.request("REQUEST-" + i);  
            }  
            Thread.sleep(3000); //wait for replies  
            client.stop();  
    }  
  
}  

最後我將上面兩個代碼都封裝到 AMQInAction.jar, 可以在這裡下載. 最後便是檢驗代碼的成果摟, 先要啟動 Broker+Worker:

# java -cp AMQInAction.jar ch7.Server
Press any key to stop the server

接著是啟動 Client 發送 request Message, 並等待回復 Message:

# java -cp AMQInAction.jar ch7.Client
Requesting: REQUEST-1
Requesting: REQUEST-2
Requesting: REQUEST-3
Requesting: REQUEST-4
...
Requesting: REQUEST-10
Received response for: Response to 'REQUEST-2'
Received response for: Response to 'REQUEST-3'
Received response for: Response to 'REQUEST-4'
Received response for: Response to 'REQUEST-5'
...

其實這樣的功能簡單使用 Java Socket 的 programming 便可以達到, 但是除此之外它帶來的好處書上有提到:

Using the request/reply pattern, envision that there are thousands of requests entering the broker every second from many clients, all distributed across many hosts. In a production system, more than just a single broker instance would be used for the purposes of redundancy, failover, and load balancing. These brokers would also be distributed across many hosts. The only way to handle this many requests would be to use many workers. Producers can always send messages much faster than a consumer can receive and process them, so lots of workers would be needed, all of them spread out across many hosts as well. The advantage of using many workers is that each one can go up and down at will, and the overall system itself isn’t affected. The producers and workers would continue to process messages, and even if one of them crashed, it wouldn’t affect the system. This is exactly how many large-scale systems can handle such a tremendous load—through the use of asynchronous messaging like that demonstrated by the request/reply pattern.

This message was edited 8 times. Last update was at 24/08/2013 10:27:06

程式扎記

標籤

2013年8月29日星期四

[Linux 命令] cut : 擷取檔案中每一行的指定範圍

2013年8月23日星期五

[ InAction Note ] Ch7. ActiveMQ App - Implementing request/reply with JMS (Note)

[Git 常見問題] error: The following untracked working tree files would be overwritten by merge

檢舉濫用情形

學習筆記

標籤

2013年8月29日 星期四